Jul 09 03:42:39.006607 ip-10-0-143-153 systemd[1]: Starting Kubernetes Kubelet... Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.455366 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460398 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460409 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460414 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460418 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460421 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460424 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460427 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 03:42:39.494999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460429 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460433 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460435 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460438 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460441 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460443 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460451 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460456 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460459 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460461 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460464 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460467 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460470 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460472 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460475 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460477 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460480 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460483 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460485 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 03:42:39.496988 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460487 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460490 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460492 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460495 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460498 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460501 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460503 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460506 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460512 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460515 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460518 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460521 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460523 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460526 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460529 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460531 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460534 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460536 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460540 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 03:42:39.516522 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460543 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460546 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460549 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460552 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460554 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460557 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460559 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460562 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460564 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460566 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460569 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460572 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460574 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460577 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460579 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460582 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460584 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460587 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460589 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460592 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 03:42:39.538920 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460596 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 03:42:39.524843 ip-10-0-143-153 systemd[1]: Started Kubernetes Kubelet. Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460599 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460602 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460604 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460607 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460609 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460612 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460615 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460617 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460620 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460622 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460625 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460627 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460630 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460632 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460634 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460637 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460639 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460642 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460644 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 03:42:39.554705 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460647 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460649 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460652 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460656 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460659 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460662 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460665 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460668 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460670 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460674 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460676 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460679 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460682 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.460685 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461341 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461347 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461351 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461369 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461372 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 03:42:39.571770 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461375 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461377 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461380 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461383 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461386 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461389 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461391 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461396 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461399 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461402 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461405 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461408 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461411 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461415 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461419 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461422 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461425 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461428 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461430 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461433 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 03:42:39.573499 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461436 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461439 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461442 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461444 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461447 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461450 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461452 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461455 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461458 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461461 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461463 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461466 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461469 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461471 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461474 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461477 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461479 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461482 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461484 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461487 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461490 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 03:42:39.577652 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461493 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461495 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461498 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461500 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461503 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461507 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461509 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461512 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461515 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461518 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461521 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461523 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461528 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461530 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461533 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461536 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461538 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461541 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461543 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 03:42:39.606763 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461547 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461551 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461554 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461556 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461559 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461563 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461565 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461568 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461570 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461573 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461575 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461578 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461581 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461583 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461586 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461589 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461591 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461594 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461598 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 03:42:39.759999 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461600 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461604 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461607 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461610 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461613 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461616 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461620 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461623 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461625 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461628 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461630 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461633 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461635 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461638 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.461640 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462028 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462035 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462038 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462042 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462044 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 03:42:39.763093 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462048 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462051 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462053 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462056 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462060 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462063 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462066 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462068 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462071 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462074 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462076 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462080 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462083 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462086 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462089 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462091 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462094 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462096 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462100 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462103 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 03:42:39.763828 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462105 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462108 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462110 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462112 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462115 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462118 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462120 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462123 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462126 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462129 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462131 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462134 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462136 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462140 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462142 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462145 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462147 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462149 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462152 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462154 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 03:42:40.007021 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462157 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462159 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462162 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462166 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462169 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462171 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462174 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462176 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462180 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462183 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462186 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462189 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462191 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462194 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462196 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462199 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462201 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462204 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462206 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462209 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 03:42:40.007799 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462212 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462215 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462217 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462220 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462222 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462225 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462227 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462230 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462232 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462234 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462237 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462242 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462245 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462248 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462251 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462255 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462258 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462261 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462264 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462266 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 03:42:40.008419 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462269 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462272 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462277 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462280 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462282 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462285 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462288 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462290 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462293 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462295 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462298 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462300 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462303 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.462306 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462379 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462386 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462392 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462397 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462401 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462416 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 03:42:40.009026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462421 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462425 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462429 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462432 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462435 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462438 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462441 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462446 2556 flags.go:64] FLAG: --cgroup-root="" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462449 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462452 2556 flags.go:64] FLAG: --client-ca-file="" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462454 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462458 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462461 2556 flags.go:64] FLAG: --cluster-domain="" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462464 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462469 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462472 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462475 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462479 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462482 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462485 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462488 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462491 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462494 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462497 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 03:42:40.009626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462500 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462503 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462508 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462511 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462514 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462517 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462520 2556 flags.go:64] FLAG: --enable-server="true" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462523 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462528 2556 flags.go:64] FLAG: --event-burst="100" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462531 2556 flags.go:64] FLAG: --event-qps="50" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462534 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462537 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462540 2556 flags.go:64] FLAG: --eviction-hard="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462543 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462546 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462550 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462553 2556 flags.go:64] FLAG: --eviction-soft="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462556 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462558 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462562 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462565 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462568 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462572 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462575 2556 flags.go:64] FLAG: --feature-gates="" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462583 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 03:42:40.010339 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462586 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462589 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462592 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462595 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462598 2556 flags.go:64] FLAG: --help="false" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462600 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462604 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462607 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462609 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462613 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462617 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462619 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462622 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462625 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462628 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462631 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462634 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462637 2556 flags.go:64] FLAG: --kube-reserved="" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462640 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462643 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462646 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462648 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462653 2556 flags.go:64] FLAG: --lock-file="" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462656 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 03:42:40.011085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462658 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462661 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462666 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462669 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462672 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462677 2556 flags.go:64] FLAG: --logging-format="text" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462680 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462684 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462686 2556 flags.go:64] FLAG: --manifest-url="" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462689 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462694 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462696 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462700 2556 flags.go:64] FLAG: --max-pods="110" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462703 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462706 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462709 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462712 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462715 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462718 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462724 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462730 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462733 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462736 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 03:42:40.011774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462747 2556 flags.go:64] FLAG: --pod-cidr="" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462750 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462755 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462758 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462761 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462764 2556 flags.go:64] FLAG: --port="10250" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462767 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462772 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00a61d782792605b6" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462775 2556 flags.go:64] FLAG: --qos-reserved="" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462778 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462781 2556 flags.go:64] FLAG: --register-node="true" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462784 2556 flags.go:64] FLAG: --register-with-taints="" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462788 2556 flags.go:64] FLAG: --registry-burst="10" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462791 2556 flags.go:64] FLAG: --registry-qps="5" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462793 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462797 2556 flags.go:64] FLAG: --reserved-memory="" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462801 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462804 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462806 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462809 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462812 2556 flags.go:64] FLAG: --runonce="false" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462815 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462818 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462821 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462824 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 03:42:40.012454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462826 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462829 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462832 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462835 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462839 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462841 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462844 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462847 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462850 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462853 2556 flags.go:64] FLAG: --system-cgroups="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462856 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462861 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462864 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462866 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462872 2556 flags.go:64] FLAG: --tls-min-version="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462874 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462877 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462880 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462883 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462886 2556 flags.go:64] FLAG: --v="2" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462889 2556 flags.go:64] FLAG: --version="false" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462893 2556 flags.go:64] FLAG: --vmodule="" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462898 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.462901 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463020 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 03:42:40.013177 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463024 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463028 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463031 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463034 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463037 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463039 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463042 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463045 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463047 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463050 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463052 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463055 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463058 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463060 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463063 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463066 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463068 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463071 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463073 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 03:42:40.013891 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463076 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463079 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463082 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463085 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463087 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463090 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463092 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463095 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463098 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463100 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463104 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463107 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463109 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463112 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463115 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463117 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463120 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463122 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463125 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 03:42:40.014448 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463128 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463132 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463135 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463139 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463142 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463144 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463147 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463150 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463152 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463155 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463157 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463160 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463163 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463166 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463168 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463172 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463175 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463178 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463180 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463183 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 03:42:40.014959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463186 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463188 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463191 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463195 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463198 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463200 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463202 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463205 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463208 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463210 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463213 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463215 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463219 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463223 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463227 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463230 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463233 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463237 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463240 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 03:42:40.015536 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463242 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463246 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463249 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463252 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463254 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463257 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463259 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463262 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463266 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463269 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463271 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463274 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463277 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463280 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463282 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463285 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463289 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463292 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463295 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463298 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 03:42:40.016035 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.463300 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.464021 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.473784 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.473801 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.473821 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.473827 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473900 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473905 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473909 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473913 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473916 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473919 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473922 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473925 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473928 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 03:42:40.016655 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473932 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473935 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473937 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473940 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473943 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473946 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473948 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473951 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473953 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473960 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473963 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473966 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473969 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473971 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473974 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473977 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473980 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473983 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473986 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 03:42:40.017073 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473988 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473991 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473994 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.473999 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474001 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474004 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474006 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474009 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474012 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474014 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474017 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474019 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474022 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474025 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474027 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474030 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474033 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474036 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474038 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474041 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 03:42:40.017666 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474043 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474046 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474049 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474052 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474055 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474057 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474060 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474062 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474065 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474068 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474070 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474073 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474076 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474078 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474081 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474087 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474091 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474094 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474097 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474100 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 03:42:40.018216 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474103 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474106 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474109 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474112 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474115 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474117 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474120 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474122 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474126 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474130 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474133 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474136 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474138 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474141 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474144 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474147 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474150 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474152 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474155 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 03:42:40.018796 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474158 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474162 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474165 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474167 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474170 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474172 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474175 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474177 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474183 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474186 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474189 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474192 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.474197 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474307 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474312 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 03:42:40.019583 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474315 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474318 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474321 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474324 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474326 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474329 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474333 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474337 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474341 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474343 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474347 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474350 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474353 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474374 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474378 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474380 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474383 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474386 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474389 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 03:42:40.020022 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474391 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474394 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474397 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474399 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474402 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474405 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474408 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474411 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474414 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474416 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474419 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474421 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474424 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474427 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474430 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474432 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474434 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474437 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474440 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474442 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 03:42:40.312923 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474445 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474447 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474450 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474453 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474456 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474459 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474463 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474465 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474468 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474471 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474473 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474476 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474478 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474481 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474483 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474486 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474488 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474491 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474495 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474498 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 03:42:40.314257 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474500 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474503 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474505 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474508 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474510 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474513 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474515 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474518 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474521 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474523 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474526 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474528 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474531 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474533 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474536 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474538 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474542 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474546 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474550 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474553 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 03:42:40.314816 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474556 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474559 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474562 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474565 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474568 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474571 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474573 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474576 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474580 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474583 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474587 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474590 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474592 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474595 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474597 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474600 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474603 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 03:42:40.315395 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:39.474605 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.474610 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.474711 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.476709 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.478331 2556 server.go:1019] "Starting client certificate rotation" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.478637 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.478689 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.481458 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.482570 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.489615 2556 log.go:25] "Validated CRI v1 runtime API" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.491553 2556 log.go:25] "Validated CRI v1 image API" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.492289 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 03:42:40.315876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.495888 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8e63b896-070c-4a68-af56-ac58163a43cb:/dev/nvme0n1p3 db392a28-f817-4b6c-a87c-0bfe1aee97f9:/dev/nvme0n1p4] Jul 09 03:42:40.316261 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.495907 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.502501 2556 manager.go:216] Machine: {Timestamp:2026-07-09 03:42:39.501091875 +0000 UTC m=+0.365702123 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105984 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec237a92a4d220672e1dc4b3df6fa411 SystemUUID:ec237a92-a4d2-2067-2e1d-c4b3df6fa411 BootID:070f6a74-6bd7-4be8-b543-38daa0ae9a5a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:dc:1b:72:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:dc:1b:72:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:5b:b3:93:2f:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.502601 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.502673 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.505482 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.505501 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.506239 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.506250 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 03:42:40.316333 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.506257 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.506722 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.507895 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.510780 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.510883 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.511541 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.511551 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.511562 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.511570 2556 kubelet.go:398] "Adding apiserver pod source" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.511579 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.512002 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.512037 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.513786 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.514527 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.517067 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.517093 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518262 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518276 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518281 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518286 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518296 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518301 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518309 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518313 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518320 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518325 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518333 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.518338 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.519067 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.519075 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.520482 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.520483 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.520665 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.523151 2556 server.go:1268] "Started kubelet" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.523459 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.523509 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.523542 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.525062 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 03:42:40.316661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.525904 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.528560 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c08227b6ee2510 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-09 03:42:39.523112208 +0000 UTC m=+0.387722454,LastTimestamp:2026-07-09 03:42:39.523112208 +0000 UTC m=+0.387722454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.531022 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.531864 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.531876 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.531956 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532468 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532467 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532490 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532488 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r58n9" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532579 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532589 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532728 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532741 2556 factory.go:55] Registering systemd factory Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532750 2556 factory.go:223] Registration of the systemd container factory successfully Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532965 2556 factory.go:153] Registering CRI-O factory Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532976 2556 factory.go:223] Registration of the crio container factory successfully Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.532994 2556 factory.go:103] Registering Raw factory Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.533006 2556 manager.go:1196] Started watching for new ooms in manager Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.533340 2556 manager.go:349] Starting recovery of all containers Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.539554 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r58n9" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.542550 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.542647 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.546061 2556 manager.go:354] Recovery completed Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.550004 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.551581 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.551603 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.551612 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552059 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552068 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552082 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552061 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.317644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552794 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552815 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.552824 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.553067 2556 policy_none.go:49] "None policy: Start" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.553078 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.553088 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.554302 2556 policy_none.go:47] "Start" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.632448 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.636841 2556 manager.go:337] "Starting Device Plugin manager" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.636886 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.636898 2556 server.go:87] "Starting device plugin registration server" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.637129 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.637140 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.637220 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.637294 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.637302 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.637880 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.637919 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.654395 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.655489 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.655525 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.655574 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.655604 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.658020 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.737225 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.738008 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.738033 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.738042 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.738063 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.747173 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.747189 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-153.ec2.internal\": node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.756246 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"] Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.756301 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.756979 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.757001 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.757016 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.758619 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.758753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.318544 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.758779 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.759253 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.759261 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.759279 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.759294 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.759279 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.759399 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.760488 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.760514 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.761187 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.761213 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.761225 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.763191 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.818912 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-153.ec2.internal\" not found" node="ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.823342 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-153.ec2.internal\" not found" node="ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.834657 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc0276188affef9bafce1dfcbb30bd47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"cc0276188affef9bafce1dfcbb30bd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.834676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f89825e5b648488da5798c096dfd777-config\") pod \"kube-apiserver-proxy-ip-10-0-143-153.ec2.internal\" (UID: \"2f89825e5b648488da5798c096dfd777\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.834698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc0276188affef9bafce1dfcbb30bd47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"cc0276188affef9bafce1dfcbb30bd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.863950 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.935578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc0276188affef9bafce1dfcbb30bd47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"cc0276188affef9bafce1dfcbb30bd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.935613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc0276188affef9bafce1dfcbb30bd47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"cc0276188affef9bafce1dfcbb30bd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.319541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.935640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f89825e5b648488da5798c096dfd777-config\") pod \"kube-apiserver-proxy-ip-10-0-143-153.ec2.internal\" (UID: \"2f89825e5b648488da5798c096dfd777\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.935661 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc0276188affef9bafce1dfcbb30bd47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"cc0276188affef9bafce1dfcbb30bd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.935676 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc0276188affef9bafce1dfcbb30bd47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"cc0276188affef9bafce1dfcbb30bd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:39.935706 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f89825e5b648488da5798c096dfd777-config\") pod \"kube-apiserver-proxy-ip-10-0-143-153.ec2.internal\" (UID: \"2f89825e5b648488da5798c096dfd777\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:39.964656 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.065461 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.122608 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.126457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.166256 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.320142 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.266767 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.521042 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.344966 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 03:42:40.521042 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.367142 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.521042 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.467673 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.521042 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.477812 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 03:42:40.521042 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.477921 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 03:42:40.521042 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.477963 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.542124 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 03:37:39 +0000 UTC" deadline="2027-12-31 15:59:29.287384402 +0000 UTC" Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.542148 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12972h16m48.745238675s" Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.568270 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:40.645333 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f89825e5b648488da5798c096dfd777.slice/crio-086d1bde22af994b03c5355c2d1bf941f931b7e7e269b67b52874c2e2238e87a WatchSource:0}: Error finding container 086d1bde22af994b03c5355c2d1bf941f931b7e7e269b67b52874c2e2238e87a: Status 404 returned error can't find the container with id 086d1bde22af994b03c5355c2d1bf941f931b7e7e269b67b52874c2e2238e87a Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:40.645773 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0276188affef9bafce1dfcbb30bd47.slice/crio-adf2c3b219973c66e0a346ec114c11bbb6d6a071aacdd78abc159b6d69e37b75 WatchSource:0}: Error finding container adf2c3b219973c66e0a346ec114c11bbb6d6a071aacdd78abc159b6d69e37b75: Status 404 returned error can't find the container with id adf2c3b219973c66e0a346ec114c11bbb6d6a071aacdd78abc159b6d69e37b75 Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.652187 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.660438 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" event={"ID":"cc0276188affef9bafce1dfcbb30bd47","Type":"ContainerStarted","Data":"adf2c3b219973c66e0a346ec114c11bbb6d6a071aacdd78abc159b6d69e37b75"} Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.661248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" event={"ID":"2f89825e5b648488da5798c096dfd777","Type":"ContainerStarted","Data":"086d1bde22af994b03c5355c2d1bf941f931b7e7e269b67b52874c2e2238e87a"} Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.668742 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:40.787125 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:40.769005 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found" Jul 09 03:42:41.047511 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.822196 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 03:42:41.047511 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.833258 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" Jul 09 03:42:41.047511 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.845706 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 03:42:41.047511 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.846648 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" Jul 09 03:42:41.047511 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.851573 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 03:42:41.047511 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:40.851988 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.512371 2556 apiserver.go:52] "Watching apiserver" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.521648 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.522900 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-tdxld","openshift-network-diagnostics/network-check-target-7kv6t","kube-system/konnectivity-agent-xphwl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn","openshift-image-registry/node-ca-sf4hd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal","openshift-multus/multus-additional-cni-plugins-tmbqj","openshift-network-operator/iptables-alerter-dqdnf","openshift-ovn-kubernetes/ovnkube-node-nj9l5","kube-system/global-pull-secret-syncer-j55t4","kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal","openshift-cluster-node-tuning-operator/tuned-r9wdg","openshift-dns/node-resolver-wrh8c","openshift-multus/multus-s89mf"] Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.526749 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.526761 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.526749 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.527200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.527981 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.528948 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529158 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529225 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2htfn\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529276 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529230 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529895 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.529904 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.530244 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.530261 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.530564 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531063 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531120 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvndz\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531139 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531613 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531619 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g2r4j\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531690 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.531965 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.532030 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9fhjl\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.532069 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7vmwv\"" Jul 09 03:42:41.559962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.532079 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.532081 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.532033 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.532229 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.532834 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.533327 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d5nxv\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.533769 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.534589 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.535052 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.535527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-drbm9\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.539254 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.539869 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.540008 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.540180 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.540262 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.540579 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.540653 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.540924 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.541651 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.542829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg5km\" (UniqueName: \"kubernetes.io/projected/0cb6747e-e5de-4778-92ea-614a0f675765-kube-api-access-jg5km\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-netns\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.561783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-cni-multus\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/662fc5c2-7647-46ff-87bb-56c8ecea778d-hosts-file\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-cni-netd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-systemd-units\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-slash\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-os-release\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-registration-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-env-overrides\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-daemon-config\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcdp\" (UniqueName: \"kubernetes.io/projected/71fd99dc-32ba-48c0-98af-e66994b90329-kube-api-access-mfcdp\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-system-cni-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5e0c420-339d-476d-8f76-965c1a8405a1-cni-binary-copy\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543985 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.543987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4tk\" (UniqueName: \"kubernetes.io/projected/662fc5c2-7647-46ff-87bb-56c8ecea778d-kube-api-access-rf4tk\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.563381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovn-node-metrics-cert\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-var-lib-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-node-log\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovnkube-script-lib\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-cnibin\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840c6d20-4e3a-401f-ba09-7051a26164ec-host\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-cnibin\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bd8b23d-7c67-4f46-848a-ebb2308ebd8a-konnectivity-ca\") pod \"konnectivity-agent-xphwl\" (UID: \"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a\") " pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-sys-fs\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-kubelet\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-k8s-cni-cncf-io\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovnkube-config\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-etc-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-log-socket\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-os-release\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-kubelet\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-hostroot\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-etc-kubernetes\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544535 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-socket-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzg9\" (UniqueName: \"kubernetes.io/projected/4db951e4-af9d-4670-87ce-06b645aebbd1-kube-api-access-jgzg9\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6d67\" (UniqueName: \"kubernetes.io/projected/b5e0c420-339d-476d-8f76-965c1a8405a1-kube-api-access-v6d67\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544593 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-device-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hkd\" (UniqueName: \"kubernetes.io/projected/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-kube-api-access-85hkd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx27k\" (UniqueName: \"kubernetes.io/projected/840c6d20-4e3a-401f-ba09-7051a26164ec-kube-api-access-bx27k\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-cni-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.564903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544747 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544773 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dvd9f\"" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-multus-certs\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bd8b23d-7c67-4f46-848a-ebb2308ebd8a-agent-certs\") pod \"konnectivity-agent-xphwl\" (UID: \"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a\") " pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-cni-bin\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840c6d20-4e3a-401f-ba09-7051a26164ec-serviceca\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544835 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cf7vs\"" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-socket-dir-parent\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.544984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662fc5c2-7647-46ff-87bb-56c8ecea778d-tmp-dir\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545003 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.566941 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-cni-bin\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545093 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-conf-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545113 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-run-netns\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-systemd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545162 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-ovn\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545189 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545213 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545236 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-system-cni-dir\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545531 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 03:42:41.567738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.545595 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.585635 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.585811 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dvb4" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.639219 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.645983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-daemon-config\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcdp\" (UniqueName: \"kubernetes.io/projected/71fd99dc-32ba-48c0-98af-e66994b90329-kube-api-access-mfcdp\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8a5f942-5372-49d7-9688-5a9cf98da450-kubelet-config\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-system-cni-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5e0c420-339d-476d-8f76-965c1a8405a1-cni-binary-copy\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4tk\" (UniqueName: \"kubernetes.io/projected/662fc5c2-7647-46ff-87bb-56c8ecea778d-kube-api-access-rf4tk\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovn-node-metrics-cert\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-host-slash\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-sys\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646213 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-system-cni-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-var-lib-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.650983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646314 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-node-log\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovnkube-script-lib\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646342 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-var-lib-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646391 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-kubernetes\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646407 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-node-log\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wnkg\" (UniqueName: \"kubernetes.io/projected/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-kube-api-access-2wnkg\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646444 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-cnibin\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840c6d20-4e3a-401f-ba09-7051a26164ec-host\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-cnibin\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bd8b23d-7c67-4f46-848a-ebb2308ebd8a-konnectivity-ca\") pod \"konnectivity-agent-xphwl\" (UID: \"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a\") " pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-cnibin\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646546 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-systemd\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-sys-fs\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.651922 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-kubelet\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysctl-d\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646663 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8a5f942-5372-49d7-9688-5a9cf98da450-dbus\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646574 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-cnibin\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-k8s-cni-cncf-io\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646549 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840c6d20-4e3a-401f-ba09-7051a26164ec-host\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646698 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovnkube-config\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646743 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-daemon-config\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646767 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-kubelet\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-lib-modules\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646739 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-etc-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646739 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5e0c420-339d-476d-8f76-965c1a8405a1-cni-binary-copy\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.652730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646823 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-k8s-cni-cncf-io\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-log-socket\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646861 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-sys-fs\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-etc-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-os-release\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646924 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-log-socket\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-kubelet\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.646992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-os-release\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647027 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-hostroot\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647053 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bd8b23d-7c67-4f46-848a-ebb2308ebd8a-konnectivity-ca\") pod \"konnectivity-agent-xphwl\" (UID: \"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a\") " pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-etc-kubernetes\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647090 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-kubelet\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-etc-kubernetes\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-socket-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-hostroot\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.653733 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzg9\" (UniqueName: \"kubernetes.io/projected/4db951e4-af9d-4670-87ce-06b645aebbd1-kube-api-access-jgzg9\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647230 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovnkube-config\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6d67\" (UniqueName: \"kubernetes.io/projected/b5e0c420-339d-476d-8f76-965c1a8405a1-kube-api-access-v6d67\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647274 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-device-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647303 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-socket-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hkd\" (UniqueName: \"kubernetes.io/projected/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-kube-api-access-85hkd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647376 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-device-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647390 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysconfig\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx27k\" (UniqueName: \"kubernetes.io/projected/840c6d20-4e3a-401f-ba09-7051a26164ec-kube-api-access-bx27k\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovnkube-script-lib\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647758 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-cni-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-cni-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.647984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648017 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:41.654351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-iptables-alerter-script\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648063 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-modprobe-d\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2kkw\" (UniqueName: \"kubernetes.io/projected/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-kube-api-access-n2kkw\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648088 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-var-lib-kubelet\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-host\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.648218 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.648287 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:42.148267878 +0000 UTC m=+3.012878128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648349 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-multus-certs\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648405 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-run\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-multus-certs\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.655165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bd8b23d-7c67-4f46-848a-ebb2308ebd8a-agent-certs\") pod \"konnectivity-agent-xphwl\" (UID: \"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a\") " pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648504 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-cni-bin\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-tmp\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840c6d20-4e3a-401f-ba09-7051a26164ec-serviceca\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648563 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-socket-dir-parent\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-cni-bin\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662fc5c2-7647-46ff-87bb-56c8ecea778d-tmp-dir\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648673 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-socket-dir-parent\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-cni-bin\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648711 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-cni-bin\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.656011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-conf-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-run-netns\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-systemd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-ovn\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648932 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662fc5c2-7647-46ff-87bb-56c8ecea778d-tmp-dir\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648935 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysctl-conf\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648994 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840c6d20-4e3a-401f-ba09-7051a26164ec-serviceca\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.648998 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-multus-conf-dir\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-system-cni-dir\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649037 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-systemd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649042 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-run-netns\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649038 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.656840 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649073 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-ovn\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649078 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb6747e-e5de-4778-92ea-614a0f675765-system-cni-dir\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649126 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-run-openvswitch\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg5km\" (UniqueName: \"kubernetes.io/projected/0cb6747e-e5de-4778-92ea-614a0f675765-kube-api-access-jg5km\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649175 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649473 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-netns\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-run-netns\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.650135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-cni-multus\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.649790 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb6747e-e5de-4778-92ea-614a0f675765-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.650825 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-host-var-lib-cni-multus\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.650778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/662fc5c2-7647-46ff-87bb-56c8ecea778d-hosts-file\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651174 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-ovn-node-metrics-cert\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-cni-netd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.657654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-systemd-units\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-slash\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-os-release\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-registration-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-env-overrides\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651418 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-cni-netd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651423 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/662fc5c2-7647-46ff-87bb-56c8ecea778d-hosts-file\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651431 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-tuned\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651489 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5e0c420-339d-476d-8f76-965c1a8405a1-os-release\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651490 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4db951e4-af9d-4670-87ce-06b645aebbd1-registration-dir\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651538 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-host-slash\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-systemd-units\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bd8b23d-7c67-4f46-848a-ebb2308ebd8a-agent-certs\") pod \"konnectivity-agent-xphwl\" (UID: \"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a\") " pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.651849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-env-overrides\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.658255 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4tk\" (UniqueName: \"kubernetes.io/projected/662fc5c2-7647-46ff-87bb-56c8ecea778d-kube-api-access-rf4tk\") pod \"node-resolver-wrh8c\" (UID: \"662fc5c2-7647-46ff-87bb-56c8ecea778d\") " pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.658493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.658278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx27k\" (UniqueName: \"kubernetes.io/projected/840c6d20-4e3a-401f-ba09-7051a26164ec-kube-api-access-bx27k\") pod \"node-ca-sf4hd\" (UID: \"840c6d20-4e3a-401f-ba09-7051a26164ec\") " pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.660196 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.659878 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:42:41.660196 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.659901 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:42:41.660196 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.659922 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:41.660196 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.659989 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:42:42.159962021 +0000 UTC m=+3.024572278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:41.660196 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.660050 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzg9\" (UniqueName: \"kubernetes.io/projected/4db951e4-af9d-4670-87ce-06b645aebbd1-kube-api-access-jgzg9\") pod \"aws-ebs-csi-driver-node-7ghgn\" (UID: \"4db951e4-af9d-4670-87ce-06b645aebbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.660926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.660625 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6d67\" (UniqueName: \"kubernetes.io/projected/b5e0c420-339d-476d-8f76-965c1a8405a1-kube-api-access-v6d67\") pod \"multus-s89mf\" (UID: \"b5e0c420-339d-476d-8f76-965c1a8405a1\") " pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.660926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.660645 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hkd\" (UniqueName: \"kubernetes.io/projected/6fbf61ff-08e1-4ed3-976e-b10adc6835e9-kube-api-access-85hkd\") pod \"ovnkube-node-nj9l5\" (UID: \"6fbf61ff-08e1-4ed3-976e-b10adc6835e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.660926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.660720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcdp\" (UniqueName: \"kubernetes.io/projected/71fd99dc-32ba-48c0-98af-e66994b90329-kube-api-access-mfcdp\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.662637 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg5km\" (UniqueName: \"kubernetes.io/projected/0cb6747e-e5de-4778-92ea-614a0f675765-kube-api-access-jg5km\") pod \"multus-additional-cni-plugins-tmbqj\" (UID: \"0cb6747e-e5de-4778-92ea-614a0f675765\") " pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8a5f942-5372-49d7-9688-5a9cf98da450-kubelet-config\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-host-slash\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-sys\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-kubernetes\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wnkg\" (UniqueName: \"kubernetes.io/projected/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-kube-api-access-2wnkg\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752416 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-systemd\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752431 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-host-slash\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752428 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8a5f942-5372-49d7-9688-5a9cf98da450-kubelet-config\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysctl-d\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752464 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-sys\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8a5f942-5372-49d7-9688-5a9cf98da450-dbus\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752501 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-kubernetes\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-lib-modules\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.900454 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752538 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8a5f942-5372-49d7-9688-5a9cf98da450-dbus\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysconfig\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysctl-d\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752585 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-systemd\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-iptables-alerter-script\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752598 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-lib-modules\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-modprobe-d\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2kkw\" (UniqueName: \"kubernetes.io/projected/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-kube-api-access-n2kkw\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752645 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysconfig\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-var-lib-kubelet\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-host\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752730 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-modprobe-d\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-run\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752751 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-var-lib-kubelet\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.901047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-tmp\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-host\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752810 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-run\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysctl-conf\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.752823 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-tuned\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:41.752879 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:42.252860839 +0000 UTC m=+3.117471100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.752977 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-sysctl-conf\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.753215 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-iptables-alerter-script\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.755024 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-etc-tuned\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.755179 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-tmp\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.762692 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wnkg\" (UniqueName: \"kubernetes.io/projected/7e14ab54-cb25-46ad-8ae3-a9373bfb8fba-kube-api-access-2wnkg\") pod \"tuned-r9wdg\" (UID: \"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba\") " pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.765268 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2kkw\" (UniqueName: \"kubernetes.io/projected/c451341e-4fd3-4e6a-a3fb-326bce7ac2eb-kube-api-access-n2kkw\") pod \"iptables-alerter-dqdnf\" (UID: \"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb\") " pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.804238 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.839913 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wrh8c" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.848484 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.858065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.864569 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" Jul 09 03:42:41.902052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.869139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sf4hd" Jul 09 03:42:41.902714 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.876744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s89mf" Jul 09 03:42:41.902714 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.882186 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:42:41.902714 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.890229 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dqdnf" Jul 09 03:42:42.105323 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:41.939395 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.156911 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.157092 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.157163 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:43.157147873 +0000 UTC m=+4.021758107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.258246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.258284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.258399 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.258411 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.258427 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.258435 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.258464 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:43.258446228 +0000 UTC m=+4.123056462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:42.261396 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.258478 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:42:43.258471816 +0000 UTC m=+4.123082050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.612436 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:37:41 +0000 UTC" deadline="2028-04-09 23:09:41.96920296 +0000 UTC" Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.612476 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15379h26m59.356737932s" Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.656057 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.656165 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:42.656342 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:42.656467 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.664634 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd8b23d_7c67_4f46_848a_ebb2308ebd8a.slice/crio-fc35171146aed2093e8aaaf07447afc4bb79ab1ee19edb3686831ff1d200250a WatchSource:0}: Error finding container fc35171146aed2093e8aaaf07447afc4bb79ab1ee19edb3686831ff1d200250a: Status 404 returned error can't find the container with id fc35171146aed2093e8aaaf07447afc4bb79ab1ee19edb3686831ff1d200250a Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.666001 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e0c420_339d_476d_8f76_965c1a8405a1.slice/crio-eec8cdf57bce2355dbdc5cd16b459714f895962a094f0c949a32acbe7894e950 WatchSource:0}: Error finding container eec8cdf57bce2355dbdc5cd16b459714f895962a094f0c949a32acbe7894e950: Status 404 returned error can't find the container with id eec8cdf57bce2355dbdc5cd16b459714f895962a094f0c949a32acbe7894e950 Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.667455 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662fc5c2_7647_46ff_87bb_56c8ecea778d.slice/crio-6ce7ae853561ae9f76cbf2f60f1ac711e9ea5e33c1c00c9f64b3b8095f57d8e4 WatchSource:0}: Error finding container 6ce7ae853561ae9f76cbf2f60f1ac711e9ea5e33c1c00c9f64b3b8095f57d8e4: Status 404 returned error can't find the container with id 6ce7ae853561ae9f76cbf2f60f1ac711e9ea5e33c1c00c9f64b3b8095f57d8e4 Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.674597 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbf61ff_08e1_4ed3_976e_b10adc6835e9.slice/crio-09ea94ed4895e15edcfa9b6c6543e24d9a7e01f9d1a0b38afe7acda895f8a87f WatchSource:0}: Error finding container 09ea94ed4895e15edcfa9b6c6543e24d9a7e01f9d1a0b38afe7acda895f8a87f: Status 404 returned error can't find the container with id 09ea94ed4895e15edcfa9b6c6543e24d9a7e01f9d1a0b38afe7acda895f8a87f Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.676100 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db951e4_af9d_4670_87ce_06b645aebbd1.slice/crio-64d6a67fa443c2283e0805a5862d0e0d706196e705bc18b2338af4d1ffc3bae6 WatchSource:0}: Error finding container 64d6a67fa443c2283e0805a5862d0e0d706196e705bc18b2338af4d1ffc3bae6: Status 404 returned error can't find the container with id 64d6a67fa443c2283e0805a5862d0e0d706196e705bc18b2338af4d1ffc3bae6 Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.681480 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb6747e_e5de_4778_92ea_614a0f675765.slice/crio-8a7d966e05558a427e5cea8f1aa7942ffb4778711cd5d6e1b02fe829f1840ad6 WatchSource:0}: Error finding container 8a7d966e05558a427e5cea8f1aa7942ffb4778711cd5d6e1b02fe829f1840ad6: Status 404 returned error can't find the container with id 8a7d966e05558a427e5cea8f1aa7942ffb4778711cd5d6e1b02fe829f1840ad6 Jul 09 03:42:42.704104 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:42:42.684378 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e14ab54_cb25_46ad_8ae3_a9373bfb8fba.slice/crio-5cb9764787bf46e188a616439ff1b4745ecdfa821bb5ec8b34ec25a25a96adca WatchSource:0}: Error finding container 5cb9764787bf46e188a616439ff1b4745ecdfa821bb5ec8b34ec25a25a96adca: Status 404 returned error can't find the container with id 5cb9764787bf46e188a616439ff1b4745ecdfa821bb5ec8b34ec25a25a96adca Jul 09 03:42:43.203645 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.164680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:43.203645 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.165047 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:43.203645 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.165103 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:45.165086086 +0000 UTC m=+6.029696322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:43.262304 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.262139 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 03:42:43.265229 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.265199 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:43.265329 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.265291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:43.265623 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.265475 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:42:43.265623 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.265495 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:42:43.265623 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.265507 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:43.265623 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.265559 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:42:45.265540741 +0000 UTC m=+6.130150981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:43.265899 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.265883 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:43.265962 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.265941 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:45.265924591 +0000 UTC m=+6.130534827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:43.613624 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.613507 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:37:41 +0000 UTC" deadline="2028-01-20 20:32:19.538597402 +0000 UTC" Jul 09 03:42:43.613624 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.613571 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13456h49m35.925031372s" Jul 09 03:42:43.658628 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.658539 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:43.658777 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:43.658665 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:43.687566 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.687523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wrh8c" event={"ID":"662fc5c2-7647-46ff-87bb-56c8ecea778d","Type":"ContainerStarted","Data":"6ce7ae853561ae9f76cbf2f60f1ac711e9ea5e33c1c00c9f64b3b8095f57d8e4"} Jul 09 03:42:43.697576 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.697546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" event={"ID":"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba","Type":"ContainerStarted","Data":"5cb9764787bf46e188a616439ff1b4745ecdfa821bb5ec8b34ec25a25a96adca"} Jul 09 03:42:43.700746 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.700717 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" event={"ID":"4db951e4-af9d-4670-87ce-06b645aebbd1","Type":"ContainerStarted","Data":"64d6a67fa443c2283e0805a5862d0e0d706196e705bc18b2338af4d1ffc3bae6"} Jul 09 03:42:43.705217 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.705193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"09ea94ed4895e15edcfa9b6c6543e24d9a7e01f9d1a0b38afe7acda895f8a87f"} Jul 09 03:42:43.710420 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.710397 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s89mf" event={"ID":"b5e0c420-339d-476d-8f76-965c1a8405a1","Type":"ContainerStarted","Data":"eec8cdf57bce2355dbdc5cd16b459714f895962a094f0c949a32acbe7894e950"} Jul 09 03:42:43.715881 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.715855 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xphwl" event={"ID":"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a","Type":"ContainerStarted","Data":"fc35171146aed2093e8aaaf07447afc4bb79ab1ee19edb3686831ff1d200250a"} Jul 09 03:42:43.729727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.729699 2556 generic.go:356] "Generic (PLEG): container finished" podID="cc0276188affef9bafce1dfcbb30bd47" containerID="23a1bb5ba6596a08288c3aabba63f0f84f1b29e6a1be902a1c18184f6f217778" exitCode=0 Jul 09 03:42:43.729838 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.729782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" event={"ID":"cc0276188affef9bafce1dfcbb30bd47","Type":"ContainerDied","Data":"23a1bb5ba6596a08288c3aabba63f0f84f1b29e6a1be902a1c18184f6f217778"} Jul 09 03:42:43.739212 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.739187 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" event={"ID":"2f89825e5b648488da5798c096dfd777","Type":"ContainerStarted","Data":"c56c01174c9540aadd4e75cd9d3a61ce3dd40e081ce065218a833636d4086576"} Jul 09 03:42:43.747811 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.747784 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerStarted","Data":"8a7d966e05558a427e5cea8f1aa7942ffb4778711cd5d6e1b02fe829f1840ad6"} Jul 09 03:42:43.755474 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.755450 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dqdnf" event={"ID":"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb","Type":"ContainerStarted","Data":"88609d63464253d5f50f9aa243f5f080fc2942270728e9feecc71a436352d9ee"} Jul 09 03:42:43.780324 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:43.780296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sf4hd" event={"ID":"840c6d20-4e3a-401f-ba09-7051a26164ec","Type":"ContainerStarted","Data":"6cb8f227986fd28ca454051762440ab3482b143ba45fad479aeae30a2f1f5eec"} Jul 09 03:42:44.656614 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:44.656585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:44.656779 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:44.656710 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:44.657104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:44.657086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:44.657233 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:44.657190 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:44.801499 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:44.801420 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" event={"ID":"cc0276188affef9bafce1dfcbb30bd47","Type":"ContainerStarted","Data":"a5c27ffafbc6f7f73074d0f991cd953d2c52e4fac1e65b1dffda02a04b9d2256"} Jul 09 03:42:44.816275 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:44.816218 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" podStartSLOduration=4.816200924 podStartE2EDuration="4.816200924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:42:44.815929331 +0000 UTC m=+5.680539588" watchObservedRunningTime="2026-07-09 03:42:44.816200924 +0000 UTC m=+5.680811185" Jul 09 03:42:44.816851 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:44.816812 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" podStartSLOduration=4.816800225 podStartE2EDuration="4.816800225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:42:43.76433897 +0000 UTC m=+4.628949228" watchObservedRunningTime="2026-07-09 03:42:44.816800225 +0000 UTC m=+5.681410483" Jul 09 03:42:45.181152 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:45.181067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:45.181317 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.181218 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:45.181317 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.181282 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:49.181261528 +0000 UTC m=+10.045871764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:45.282211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:45.282312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.282446 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.282507 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:49.282488955 +0000 UTC m=+10.147099189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.282896 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.282917 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.282929 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:45.283023 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.282972 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:42:49.282958642 +0000 UTC m=+10.147568878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:45.656976 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:45.656453 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:45.656976 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:45.656570 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:46.656186 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:46.656016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:46.656186 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:46.656160 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:46.656719 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:46.656566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:46.656719 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:46.656655 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:47.658343 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:47.657850 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:47.658343 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:47.657985 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:48.655796 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:48.655763 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:48.655946 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:48.655816 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:48.655946 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:48.655901 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:48.656073 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:48.656024 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:49.213007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:49.212972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:49.213455 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.213147 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:49.213455 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.213211 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:57.213194833 +0000 UTC m=+18.077805066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:49.313818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:49.313907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.313977 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.314026 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.314043 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.314046 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:42:57.314024865 +0000 UTC m=+18.178635115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.314055 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:49.314123 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.314099 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:42:57.314084561 +0000 UTC m=+18.178694800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:49.657805 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:49.657034 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:49.657805 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:49.657153 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:50.656646 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:50.656518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:50.657105 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:50.656640 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:50.657105 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:50.656841 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:50.657105 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:50.656984 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:51.656622 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:51.656555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:51.656808 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:51.656742 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:52.656711 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:52.656677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:52.656936 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:52.656811 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:52.656936 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:52.656913 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:52.657398 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:52.657050 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:53.656737 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:53.656661 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:53.656874 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:53.656793 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:53.820390 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:53.820339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xphwl" event={"ID":"2bd8b23d-7c67-4f46-848a-ebb2308ebd8a","Type":"ContainerStarted","Data":"a5c4903bbd248ffa3deb0868798eab6b43130b79565bb987668c1b3194768ec3"} Jul 09 03:42:53.821960 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:53.821930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" event={"ID":"4db951e4-af9d-4670-87ce-06b645aebbd1","Type":"ContainerStarted","Data":"e8bd42f25ea55a3660db4a2458536f0da989b4363c9448a5370629be710e802f"} Jul 09 03:42:53.834415 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:53.834346 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xphwl" podStartSLOduration=4.505859829 podStartE2EDuration="14.834332154s" totalImagesPullingTime="10.328472325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:42:53.833947168 +0000 UTC m=+14.698557425" watchObservedRunningTime="2026-07-09 03:42:53.834332154 +0000 UTC m=+14.698942409" Jul 09 03:42:54.656443 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:54.656388 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:54.656606 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:54.656512 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:54.656606 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:54.656569 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:54.656730 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:54.656661 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:55.656757 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:55.656727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:55.657227 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:55.656848 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:56.656109 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:56.656075 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:56.656294 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:56.656075 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:56.656294 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:56.656215 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:56.656294 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:56.656258 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:56.979375 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:56.979286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:56.979882 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:56.979861 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:42:57.281935 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:57.281848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:57.282148 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.281997 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:57.282148 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.282048 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:13.282029601 +0000 UTC m=+34.146639837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:42:57.383010 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:57.382979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:57.383010 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:57.383013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:57.383174 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.383116 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:57.383174 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.383124 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:42:57.383174 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.383141 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:42:57.383174 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.383150 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:57.383174 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.383172 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:13.383156991 +0000 UTC m=+34.247767225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:42:57.383318 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.383189 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:43:13.38317835 +0000 UTC m=+34.247788584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:42:57.656326 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:57.656255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:57.656496 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:57.656381 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:42:58.656035 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:58.656006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:42:58.656475 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:58.656117 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:42:58.656475 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:58.656210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:42:58.656475 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:58.656321 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:42:59.659169 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:42:59.659137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:42:59.659623 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:42:59.659248 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:00.655970 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:00.655930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:00.656140 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:00.655930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:00.656140 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:00.656048 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:00.656388 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:00.656158 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:01.589347 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.589080 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 03:43:01.647889 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.647771 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T03:43:01.589330298Z","UUID":"44b937ee-fd58-482e-91d6-850f2bd806e5","Handler":null,"Name":"","Endpoint":""} Jul 09 03:43:01.649453 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.649378 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 03:43:01.649453 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.649415 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 03:43:01.655820 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.655793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:01.656257 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:01.656228 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:01.840730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.840693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" event={"ID":"7e14ab54-cb25-46ad-8ae3-a9373bfb8fba","Type":"ContainerStarted","Data":"cf93a094a1d7f5a1f71ac0a52db5b186fa4eace8165a5fad86feedcd24f14ad1"} Jul 09 03:43:01.842558 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.842534 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" event={"ID":"4db951e4-af9d-4670-87ce-06b645aebbd1","Type":"ContainerStarted","Data":"b59b69303d38bf2995cc588b957fa82a105ac2c436bff9f08203dbfc997fabbe"} Jul 09 03:43:01.845274 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.845253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"f377dbe0fcdfb268f9e786e9eeda9378ebc20d8e2d3885e8901297a90a417d18"} Jul 09 03:43:01.845399 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.845320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"d173ca44dbc3b602f05dc960a58eeaf36ea4200203e862f694ed287cf5d049e7"} Jul 09 03:43:01.845399 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.845383 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"3094c32bc69b712e9e3dc0a68457d8a39b4fb21430710f1fee51badc8aa98665"} Jul 09 03:43:01.845476 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.845425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"d748a3e1c98667fbe19e3a9db8e681686ce93ef3a6f13291c0a78f031c014b50"} Jul 09 03:43:01.845476 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.845454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"9d98497438a43c1efc9fdafb02afd6ac262b0d197e9ad989659e313310d0d059"} Jul 09 03:43:01.846738 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.846715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s89mf" event={"ID":"b5e0c420-339d-476d-8f76-965c1a8405a1","Type":"ContainerStarted","Data":"4941a0d4ea6d02f41b3aeb66ea41a37defbfa6d37b22575c267ea38185e563ca"} Jul 09 03:43:01.848014 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.847991 2556 generic.go:356] "Generic (PLEG): container finished" podID="0cb6747e-e5de-4778-92ea-614a0f675765" containerID="a583542ab95ccd3afc3b62128975024603aad9663f7efcfdae78f590e327b34c" exitCode=0 Jul 09 03:43:01.848097 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.848067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerDied","Data":"a583542ab95ccd3afc3b62128975024603aad9663f7efcfdae78f590e327b34c"} Jul 09 03:43:01.849583 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.849437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sf4hd" event={"ID":"840c6d20-4e3a-401f-ba09-7051a26164ec","Type":"ContainerStarted","Data":"85455c6ce964cb18f9ed64405a96784a6532aefdc07d81ef77d7163d4360e089"} Jul 09 03:43:01.850905 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.850885 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wrh8c" event={"ID":"662fc5c2-7647-46ff-87bb-56c8ecea778d","Type":"ContainerStarted","Data":"f8a1ad237b4ab3e93e8250353f440533e6e48257a2dc90f42eed7ba63549f2d0"} Jul 09 03:43:01.859024 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.858990 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r9wdg" podStartSLOduration=4.371670625 podStartE2EDuration="22.858979806s" totalImagesPullingTime="18.487309181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:01.858387232 +0000 UTC m=+22.722997487" watchObservedRunningTime="2026-07-09 03:43:01.858979806 +0000 UTC m=+22.723590062" Jul 09 03:43:01.892242 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.892201 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s89mf" podStartSLOduration=4.206082818 podStartE2EDuration="22.892187019s" totalImagesPullingTime="18.686104201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:01.891841323 +0000 UTC m=+22.756451578" watchObservedRunningTime="2026-07-09 03:43:01.892187019 +0000 UTC m=+22.756797274" Jul 09 03:43:01.907672 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:01.907626 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wrh8c" podStartSLOduration=12.557537964 podStartE2EDuration="22.907612214s" totalImagesPullingTime="10.35007425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:01.907127589 +0000 UTC m=+22.771737857" watchObservedRunningTime="2026-07-09 03:43:01.907612214 +0000 UTC m=+22.772222470" Jul 09 03:43:02.656225 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.656193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:02.656663 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:02.656303 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:02.656663 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.656369 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:02.656663 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:02.656470 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:02.854740 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.854679 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dqdnf" event={"ID":"c451341e-4fd3-4e6a-a3fb-326bce7ac2eb","Type":"ContainerStarted","Data":"c7cea094c073e34e61998cbf0544c30772107f8abb621724e4aa459277cabd90"} Jul 09 03:43:02.856933 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.856910 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" event={"ID":"4db951e4-af9d-4670-87ce-06b645aebbd1","Type":"ContainerStarted","Data":"b4e92683928f879be4c17accf6957f24720713e3c0ad9e81a896a27645293696"} Jul 09 03:43:02.863704 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.863677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"446b13ba17b0a8990bd8e562bb913512888be8c4b96d3f9317b2e42a5d6be4c1"} Jul 09 03:43:02.873095 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.873058 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sf4hd" podStartSLOduration=13.53831018 podStartE2EDuration="23.873046432s" totalImagesPullingTime="10.334736252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:01.920393956 +0000 UTC m=+22.785004213" watchObservedRunningTime="2026-07-09 03:43:02.873046432 +0000 UTC m=+23.737656688" Jul 09 03:43:02.873298 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.873259 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dqdnf" podStartSLOduration=13.537203535 podStartE2EDuration="23.873247992s" totalImagesPullingTime="10.336044457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:02.87262947 +0000 UTC m=+23.737239726" watchObservedRunningTime="2026-07-09 03:43:02.873247992 +0000 UTC m=+23.737858249" Jul 09 03:43:02.889535 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:02.889494 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ghgn" podStartSLOduration=4.323681111 podStartE2EDuration="23.889482775s" totalImagesPullingTime="19.565801664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:02.889120975 +0000 UTC m=+23.753731231" watchObservedRunningTime="2026-07-09 03:43:02.889482775 +0000 UTC m=+23.754093030" Jul 09 03:43:03.656593 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:03.656338 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:03.656593 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:03.656495 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:04.656084 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:04.655929 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:04.656268 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:04.655934 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:04.656268 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:04.656169 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:04.656370 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:04.656261 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:04.870983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:04.870939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"cf3bba08deb4839dca5cd16f8fd42cbb10f75db1f6fa4923c7176f8abd1b3368"} Jul 09 03:43:05.656636 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:05.656603 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:05.656822 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:05.656744 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:06.656075 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:06.656000 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:06.656633 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:06.656128 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:06.656633 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:06.656177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:06.656633 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:06.656290 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:07.656782 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.656560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:07.657373 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:07.656811 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:07.879929 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.879895 2556 generic.go:356] "Generic (PLEG): container finished" podID="0cb6747e-e5de-4778-92ea-614a0f675765" containerID="98c0784e1fa52d19deb7cb6da70e6b05c5f1c1988b39d53129d9d32a85a7ff01" exitCode=0 Jul 09 03:43:07.880083 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.879984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerDied","Data":"98c0784e1fa52d19deb7cb6da70e6b05c5f1c1988b39d53129d9d32a85a7ff01"} Jul 09 03:43:07.885971 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.885950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" event={"ID":"6fbf61ff-08e1-4ed3-976e-b10adc6835e9","Type":"ContainerStarted","Data":"4941eb175ff47c85044f3bef8dff3e2a4eb7f35723dbe59ab65f04e24ad99fe5"} Jul 09 03:43:07.886189 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.886171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:43:07.886291 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.886228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:43:07.901404 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.901386 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:43:07.926124 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.926050 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" podStartSLOduration=10.247121039 podStartE2EDuration="28.926037413s" totalImagesPullingTime="18.678916374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:07.925810695 +0000 UTC m=+28.790420951" watchObservedRunningTime="2026-07-09 03:43:07.926037413 +0000 UTC m=+28.790647668" Jul 09 03:43:07.962618 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.962594 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:43:07.962749 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.962719 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 03:43:07.963501 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:07.963477 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xphwl" Jul 09 03:43:08.656261 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:08.656226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:08.656524 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:08.656335 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:08.656524 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:08.656397 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:08.656524 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:08.656491 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:08.887953 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:08.887922 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:43:08.902970 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:08.902946 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:43:09.656514 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:09.656484 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:09.656670 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:09.656583 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:09.891567 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:09.891533 2556 generic.go:356] "Generic (PLEG): container finished" podID="0cb6747e-e5de-4778-92ea-614a0f675765" containerID="ce5acd6481ed0b943767e28884d92c1a39fdd3f0b0cd108f23d6810cbb7ec080" exitCode=0 Jul 09 03:43:09.891903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:09.891609 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerDied","Data":"ce5acd6481ed0b943767e28884d92c1a39fdd3f0b0cd108f23d6810cbb7ec080"} Jul 09 03:43:10.656480 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:10.656447 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:10.656631 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:10.656447 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:10.656631 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:10.656558 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:10.656710 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:10.656636 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:11.655821 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:11.655792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:11.656211 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:11.655917 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:11.898368 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:11.898319 2556 generic.go:356] "Generic (PLEG): container finished" podID="0cb6747e-e5de-4778-92ea-614a0f675765" containerID="f1410b8de5dcf82a9d134893ce65efc5dbca2a2e264ff08cf973819ce756741e" exitCode=0 Jul 09 03:43:11.898524 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:11.898376 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerDied","Data":"f1410b8de5dcf82a9d134893ce65efc5dbca2a2e264ff08cf973819ce756741e"} Jul 09 03:43:12.656557 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:12.656518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:12.656557 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:12.656537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:12.656962 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:12.656631 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:12.656962 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:12.656741 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:13.305369 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:13.305329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:13.305551 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.305494 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:43:13.305614 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.305564 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs podName:71fd99dc-32ba-48c0-98af-e66994b90329 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:45.305543088 +0000 UTC m=+66.170153322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs") pod "network-metrics-daemon-tdxld" (UID: "71fd99dc-32ba-48c0-98af-e66994b90329") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 03:43:13.406107 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:13.406079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:13.406227 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:13.406131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:13.406227 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.406210 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 03:43:13.406297 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.406224 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 03:43:13.406297 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.406241 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 03:43:13.406297 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.406251 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prpjn for pod openshift-network-diagnostics/network-check-target-7kv6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:43:13.406297 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.406262 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret podName:c8a5f942-5372-49d7-9688-5a9cf98da450 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:45.406248032 +0000 UTC m=+66.270858270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret") pod "global-pull-secret-syncer-j55t4" (UID: "c8a5f942-5372-49d7-9688-5a9cf98da450") : object "kube-system"/"original-pull-secret" not registered Jul 09 03:43:13.406297 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.406286 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn podName:3bcc4451-be0c-4352-a439-d10fe48d83fe nodeName:}" failed. No retries permitted until 2026-07-09 03:43:45.406273969 +0000 UTC m=+66.270884204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-prpjn" (UniqueName: "kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn") pod "network-check-target-7kv6t" (UID: "3bcc4451-be0c-4352-a439-d10fe48d83fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 03:43:13.656596 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:13.656531 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:13.656939 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:13.656654 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:14.656275 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:14.656244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:14.656478 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:14.656375 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:14.656478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:14.656407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:14.656591 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:14.656497 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:15.655938 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:15.655906 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:15.656294 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:15.656000 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:16.656463 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:16.656428 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:16.656463 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:16.656443 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:16.656943 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:16.656554 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:16.656943 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:16.656677 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:17.656727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:17.656690 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:17.657162 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:17.656823 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:18.656682 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:18.656653 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:18.656848 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:18.656748 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:18.656848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:18.656773 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:18.656848 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:18.656826 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:18.916202 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:18.916176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerStarted","Data":"37bc1e8e5063523c3baa691bd253c39f12a45ebad4a79734caade16cee9bdf15"} Jul 09 03:43:19.657165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:19.657137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:19.657519 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:19.657214 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:19.920516 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:19.920293 2556 generic.go:356] "Generic (PLEG): container finished" podID="0cb6747e-e5de-4778-92ea-614a0f675765" containerID="37bc1e8e5063523c3baa691bd253c39f12a45ebad4a79734caade16cee9bdf15" exitCode=0 Jul 09 03:43:19.920516 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:19.920379 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerDied","Data":"37bc1e8e5063523c3baa691bd253c39f12a45ebad4a79734caade16cee9bdf15"} Jul 09 03:43:20.655879 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:20.655846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:20.656028 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:20.655846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:20.656028 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:20.655954 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:20.656028 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:20.656018 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:20.926207 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:20.926138 2556 generic.go:356] "Generic (PLEG): container finished" podID="0cb6747e-e5de-4778-92ea-614a0f675765" containerID="3d44ea6762b87d0faa7fa548a170f9eff1413d770dd1c947807f96565d73d3a1" exitCode=0 Jul 09 03:43:20.926625 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:20.926204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerDied","Data":"3d44ea6762b87d0faa7fa548a170f9eff1413d770dd1c947807f96565d73d3a1"} Jul 09 03:43:21.326460 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.326284 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kv6t"] Jul 09 03:43:21.326619 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.326475 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:21.326619 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:21.326578 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:21.329620 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.329593 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j55t4"] Jul 09 03:43:21.329704 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.329692 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:21.329817 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:21.329782 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:21.330244 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.330220 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tdxld"] Jul 09 03:43:21.330341 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.330309 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:21.330444 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:21.330407 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:21.931461 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:21.931283 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" event={"ID":"0cb6747e-e5de-4778-92ea-614a0f675765","Type":"ContainerStarted","Data":"30dc8ca2c7119f9c5048318ed1ad508e31d321c047d340d8a5117419fb807507"} Jul 09 03:43:22.656574 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:22.656539 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:22.656574 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:22.656572 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:22.656761 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:22.656542 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:22.656761 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:22.656631 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:22.656761 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:22.656730 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:22.656863 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:22.656789 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:24.655736 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.655706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:24.656303 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.655823 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:24.656303 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:24.655836 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tdxld" podUID="71fd99dc-32ba-48c0-98af-e66994b90329" Jul 09 03:43:24.656303 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.655852 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:24.656303 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:24.655924 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kv6t" podUID="3bcc4451-be0c-4352-a439-d10fe48d83fe" Jul 09 03:43:24.656303 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:24.656011 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j55t4" podUID="c8a5f942-5372-49d7-9688-5a9cf98da450" Jul 09 03:43:24.930112 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.930047 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeReady" Jul 09 03:43:24.930276 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.930168 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 03:43:24.966651 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.966605 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tmbqj" podStartSLOduration=20.987216796 podStartE2EDuration="45.966589569s" totalImagesPullingTime="24.979372773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:21.955877859 +0000 UTC m=+42.820488109" watchObservedRunningTime="2026-07-09 03:43:24.966589569 +0000 UTC m=+45.831199825" Jul 09 03:43:24.967060 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.967045 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-766ffc464c-9vmtx"] Jul 09 03:43:24.988369 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.988298 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ml6k2"] Jul 09 03:43:24.988521 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.988499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:24.990858 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.990825 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 03:43:24.991012 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.990991 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 03:43:24.991075 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.991010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nqczr\"" Jul 09 03:43:24.991503 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.991369 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 03:43:24.997205 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:24.997167 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 03:43:25.004302 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.004283 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4b998"] Jul 09 03:43:25.004424 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.004408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.007097 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.007069 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phtqr\"" Jul 09 03:43:25.007097 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.007083 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 03:43:25.007253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.007098 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 03:43:25.007253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.007125 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 03:43:25.007253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.007163 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 03:43:25.026526 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.026508 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766ffc464c-9vmtx"] Jul 09 03:43:25.026611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.026537 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ml6k2"] Jul 09 03:43:25.026611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.026561 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4b998"] Jul 09 03:43:25.026611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.026577 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9h6bv"] Jul 09 03:43:25.026743 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.026611 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.028963 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.028947 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 03:43:25.029280 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.029261 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 03:43:25.029368 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.029267 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4rlp\"" Jul 09 03:43:25.029421 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.029411 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 03:43:25.044516 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.044495 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9h6bv"] Jul 09 03:43:25.044592 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.044563 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.046810 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.046791 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 03:43:25.047047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.047034 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hwlx6\"" Jul 09 03:43:25.047098 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.047070 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 03:43:25.078907 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.078891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh"] Jul 09 03:43:25.100662 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100641 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh"] Jul 09 03:43:25.100737 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:25.100775 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjfck\" (UniqueName: \"kubernetes.io/projected/999bfc7d-3bba-4a24-9164-4ea904ee6d20-kube-api-access-cjfck\") pod \"ingress-canary-4b998\" (UID: \"999bfc7d-3bba-4a24-9164-4ea904ee6d20\") " pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.100814 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d4df1af-8878-43f4-b212-7271c805b99e-metrics-tls\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.100814 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4df1af-8878-43f4-b212-7271c805b99e-tmp-dir\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.100814 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-trusted-ca\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.100956 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec30039-dbd0-4618-b240-5be7fd9f219e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.100998 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999bfc7d-3bba-4a24-9164-4ea904ee6d20-cert\") pod \"ingress-canary-4b998\" (UID: \"999bfc7d-3bba-4a24-9164-4ea904ee6d20\") " pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.101050 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.100992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l56hp\" (UniqueName: \"kubernetes.io/projected/4d4df1af-8878-43f4-b212-7271c805b99e-kube-api-access-l56hp\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.101050 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101027 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-installation-pull-secrets\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101130 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg587\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-kube-api-access-pg587\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101130 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-ca-trust-extracted\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101130 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-registry-tls\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101233 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101131 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-bound-sa-token\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101233 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-registry-certificates\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101292 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4df1af-8878-43f4-b212-7271c805b99e-config-volume\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.101292 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-image-registry-private-configuration\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.101392 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101379 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ec30039-dbd0-4618-b240-5be7fd9f219e-crio-socket\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.101434 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec30039-dbd0-4618-b240-5be7fd9f219e-data-volume\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.101434 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec30039-dbd0-4618-b240-5be7fd9f219e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.101501 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.101450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvvb\" (UniqueName: \"kubernetes.io/projected/0ec30039-dbd0-4618-b240-5be7fd9f219e-kube-api-access-rrvvb\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.102925 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.102908 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w7l9m\"" Jul 09 03:43:25.103010 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.102965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 03:43:25.201947 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.201899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec30039-dbd0-4618-b240-5be7fd9f219e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.201947 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.201926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999bfc7d-3bba-4a24-9164-4ea904ee6d20-cert\") pod \"ingress-canary-4b998\" (UID: \"999bfc7d-3bba-4a24-9164-4ea904ee6d20\") " pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.201947 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.201943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l56hp\" (UniqueName: \"kubernetes.io/projected/4d4df1af-8878-43f4-b212-7271c805b99e-kube-api-access-l56hp\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.201963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-installation-pull-secrets\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.201991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg587\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-kube-api-access-pg587\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-ca-trust-extracted\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-registry-tls\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-bound-sa-token\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-registry-certificates\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4df1af-8878-43f4-b212-7271c805b99e-config-volume\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202164 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-image-registry-private-configuration\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ec30039-dbd0-4618-b240-5be7fd9f219e-crio-socket\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec30039-dbd0-4618-b240-5be7fd9f219e-data-volume\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec30039-dbd0-4618-b240-5be7fd9f219e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvvb\" (UniqueName: \"kubernetes.io/projected/0ec30039-dbd0-4618-b240-5be7fd9f219e-kube-api-access-rrvvb\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41e4af71-f589-48c0-b40e-d35dc41b419f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntmrh\" (UID: \"41e4af71-f589-48c0-b40e-d35dc41b419f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjfck\" (UniqueName: \"kubernetes.io/projected/999bfc7d-3bba-4a24-9164-4ea904ee6d20-kube-api-access-cjfck\") pod \"ingress-canary-4b998\" (UID: \"999bfc7d-3bba-4a24-9164-4ea904ee6d20\") " pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202382 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d4df1af-8878-43f4-b212-7271c805b99e-metrics-tls\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4df1af-8878-43f4-b212-7271c805b99e-tmp-dir\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.202436 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-trusted-ca\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202825 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202474 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-ca-trust-extracted\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.202825 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202698 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ec30039-dbd0-4618-b240-5be7fd9f219e-crio-socket\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.202905 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.202835 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4df1af-8878-43f4-b212-7271c805b99e-config-volume\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.203061 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.203034 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec30039-dbd0-4618-b240-5be7fd9f219e-data-volume\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.203061 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.203046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec30039-dbd0-4618-b240-5be7fd9f219e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.203156 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.203145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4df1af-8878-43f4-b212-7271c805b99e-tmp-dir\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.205899 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.205873 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec30039-dbd0-4618-b240-5be7fd9f219e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.205984 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.205915 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d4df1af-8878-43f4-b212-7271c805b99e-metrics-tls\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.206087 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.206072 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999bfc7d-3bba-4a24-9164-4ea904ee6d20-cert\") pod \"ingress-canary-4b998\" (UID: \"999bfc7d-3bba-4a24-9164-4ea904ee6d20\") " pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.211113 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.211070 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l56hp\" (UniqueName: \"kubernetes.io/projected/4d4df1af-8878-43f4-b212-7271c805b99e-kube-api-access-l56hp\") pod \"dns-default-9h6bv\" (UID: \"4d4df1af-8878-43f4-b212-7271c805b99e\") " pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.211543 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.211526 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjfck\" (UniqueName: \"kubernetes.io/projected/999bfc7d-3bba-4a24-9164-4ea904ee6d20-kube-api-access-cjfck\") pod \"ingress-canary-4b998\" (UID: \"999bfc7d-3bba-4a24-9164-4ea904ee6d20\") " pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.211907 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.211890 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvvb\" (UniqueName: \"kubernetes.io/projected/0ec30039-dbd0-4618-b240-5be7fd9f219e-kube-api-access-rrvvb\") pod \"insights-runtime-extractor-ml6k2\" (UID: \"0ec30039-dbd0-4618-b240-5be7fd9f219e\") " pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.212940 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.212915 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-registry-certificates\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.213048 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.213030 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-trusted-ca\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.214569 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.214544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-registry-tls\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.214823 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.214799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-installation-pull-secrets\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.214981 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.214963 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg587\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-kube-api-access-pg587\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.215039 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.214964 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-bound-sa-token\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.215408 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.215385 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ffe74ae-76bc-4304-b0a9-058bc3f47f6a-image-registry-private-configuration\") pod \"image-registry-766ffc464c-9vmtx\" (UID: \"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a\") " pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.299473 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.299449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.303697 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.303680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41e4af71-f589-48c0-b40e-d35dc41b419f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntmrh\" (UID: \"41e4af71-f589-48c0-b40e-d35dc41b419f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:25.303762 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:25.303755 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 09 03:43:25.303809 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:25.303805 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e4af71-f589-48c0-b40e-d35dc41b419f-tls-certificates podName:41e4af71-f589-48c0-b40e-d35dc41b419f nodeName:}" failed. No retries permitted until 2026-07-09 03:43:25.803793654 +0000 UTC m=+46.668403888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/41e4af71-f589-48c0-b40e-d35dc41b419f-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-ntmrh" (UID: "41e4af71-f589-48c0-b40e-d35dc41b419f") : secret "prometheus-operator-admission-webhook-tls" not found Jul 09 03:43:25.312478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.312460 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ml6k2" Jul 09 03:43:25.335071 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.334916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4b998" Jul 09 03:43:25.351931 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.351912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:25.524243 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.524213 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766ffc464c-9vmtx"] Jul 09 03:43:25.527162 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.527143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9h6bv"] Jul 09 03:43:25.529624 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.529600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4b998"] Jul 09 03:43:25.530332 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:25.530302 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffe74ae_76bc_4304_b0a9_058bc3f47f6a.slice/crio-723870e48eb718e5d498a13cd6435ef58e01737703020db7c73b88c9b05b6d1e WatchSource:0}: Error finding container 723870e48eb718e5d498a13cd6435ef58e01737703020db7c73b88c9b05b6d1e: Status 404 returned error can't find the container with id 723870e48eb718e5d498a13cd6435ef58e01737703020db7c73b88c9b05b6d1e Jul 09 03:43:25.531094 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:25.531074 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4df1af_8878_43f4_b212_7271c805b99e.slice/crio-1b6aca46ad93e8d3052ab55a974e544e28f560a132729c66767433f5e2d0593a WatchSource:0}: Error finding container 1b6aca46ad93e8d3052ab55a974e544e28f560a132729c66767433f5e2d0593a: Status 404 returned error can't find the container with id 1b6aca46ad93e8d3052ab55a974e544e28f560a132729c66767433f5e2d0593a Jul 09 03:43:25.532336 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:25.532316 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999bfc7d_3bba_4a24_9164_4ea904ee6d20.slice/crio-30e15ae3bab9fb9acd2dd9b71d1a1b5856a5ea3c4eae153e57a230f296d787f7 WatchSource:0}: Error finding container 30e15ae3bab9fb9acd2dd9b71d1a1b5856a5ea3c4eae153e57a230f296d787f7: Status 404 returned error can't find the container with id 30e15ae3bab9fb9acd2dd9b71d1a1b5856a5ea3c4eae153e57a230f296d787f7 Jul 09 03:43:25.537585 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.537565 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ml6k2"] Jul 09 03:43:25.540653 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:25.540633 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec30039_dbd0_4618_b240_5be7fd9f219e.slice/crio-58e71179a91835a1d6c6348ad298aef9b956f32b5e1dd1864afd80606c7f2d95 WatchSource:0}: Error finding container 58e71179a91835a1d6c6348ad298aef9b956f32b5e1dd1864afd80606c7f2d95: Status 404 returned error can't find the container with id 58e71179a91835a1d6c6348ad298aef9b956f32b5e1dd1864afd80606c7f2d95 Jul 09 03:43:25.808786 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.808573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41e4af71-f589-48c0-b40e-d35dc41b419f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntmrh\" (UID: \"41e4af71-f589-48c0-b40e-d35dc41b419f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:25.812252 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.812226 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41e4af71-f589-48c0-b40e-d35dc41b419f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntmrh\" (UID: \"41e4af71-f589-48c0-b40e-d35dc41b419f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:25.941903 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.941863 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9h6bv" event={"ID":"4d4df1af-8878-43f4-b212-7271c805b99e","Type":"ContainerStarted","Data":"1b6aca46ad93e8d3052ab55a974e544e28f560a132729c66767433f5e2d0593a"} Jul 09 03:43:25.943805 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.943769 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4b998" event={"ID":"999bfc7d-3bba-4a24-9164-4ea904ee6d20","Type":"ContainerStarted","Data":"30e15ae3bab9fb9acd2dd9b71d1a1b5856a5ea3c4eae153e57a230f296d787f7"} Jul 09 03:43:25.946141 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.946059 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" event={"ID":"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a","Type":"ContainerStarted","Data":"c832ca637c8dbbb978a1bb62ad0dbcf9aba060711551c92610bf30c050b763b4"} Jul 09 03:43:25.946141 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.946098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" event={"ID":"7ffe74ae-76bc-4304-b0a9-058bc3f47f6a","Type":"ContainerStarted","Data":"723870e48eb718e5d498a13cd6435ef58e01737703020db7c73b88c9b05b6d1e"} Jul 09 03:43:25.946326 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.946314 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:25.947590 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.947564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ml6k2" event={"ID":"0ec30039-dbd0-4618-b240-5be7fd9f219e","Type":"ContainerStarted","Data":"58e71179a91835a1d6c6348ad298aef9b956f32b5e1dd1864afd80606c7f2d95"} Jul 09 03:43:25.965166 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:25.965114 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" podStartSLOduration=6.965095248 podStartE2EDuration="6.965095248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:25.964056616 +0000 UTC m=+46.828666873" watchObservedRunningTime="2026-07-09 03:43:25.965095248 +0000 UTC m=+46.829705505" Jul 09 03:43:26.008277 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.008222 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:26.195525 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.195489 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh"] Jul 09 03:43:26.198641 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:26.198613 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e4af71_f589_48c0_b40e_d35dc41b419f.slice/crio-be3e6f6f29cba9fbbddf1d147d7f0761430456b7a622a61b6aa6857a09977282 WatchSource:0}: Error finding container be3e6f6f29cba9fbbddf1d147d7f0761430456b7a622a61b6aa6857a09977282: Status 404 returned error can't find the container with id be3e6f6f29cba9fbbddf1d147d7f0761430456b7a622a61b6aa6857a09977282 Jul 09 03:43:26.658154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.656485 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:26.658154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.656970 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:26.658154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.657404 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:26.663136 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.660560 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-54tq2\"" Jul 09 03:43:26.663136 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.660814 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 03:43:26.663136 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.661424 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 03:43:26.663136 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.661701 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 03:43:26.663136 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.661890 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ch8mv\"" Jul 09 03:43:26.663136 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.662090 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 03:43:26.952478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:26.952333 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" event={"ID":"41e4af71-f589-48c0-b40e-d35dc41b419f","Type":"ContainerStarted","Data":"be3e6f6f29cba9fbbddf1d147d7f0761430456b7a622a61b6aa6857a09977282"} Jul 09 03:43:27.857529 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.857495 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d76cf487f-9xhfr"] Jul 09 03:43:27.871547 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.871524 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d76cf487f-9xhfr"] Jul 09 03:43:27.871669 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.871646 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:27.874471 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.874437 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 03:43:27.874587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.874473 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 03:43:27.874587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.874505 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 03:43:27.874587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.874561 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-65kcj\"" Jul 09 03:43:27.874587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.874505 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 03:43:27.874804 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.874588 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 03:43:27.875565 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.875534 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 03:43:27.875565 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.875547 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 03:43:27.934332 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.934299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-oauth-config\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:27.934480 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.934376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-config\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:27.934480 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.934447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7bq\" (UniqueName: \"kubernetes.io/projected/693ea769-279d-409b-8a8a-cd6dc5c0613d-kube-api-access-cc7bq\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:27.934598 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.934482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-serving-cert\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:27.934598 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.934499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-service-ca\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:27.934598 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:27.934522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-oauth-serving-cert\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.035024 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.034988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-oauth-config\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.035611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.035062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-config\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.035611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.035084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7bq\" (UniqueName: \"kubernetes.io/projected/693ea769-279d-409b-8a8a-cd6dc5c0613d-kube-api-access-cc7bq\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.035611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.035127 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-serving-cert\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.035611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.035151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-service-ca\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.035611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.035184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-oauth-serving-cert\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.036041 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.035992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-config\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.036041 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.036024 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-oauth-serving-cert\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.036207 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.036130 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-service-ca\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.038496 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.038453 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-oauth-config\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.038614 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.038527 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-serving-cert\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.043090 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.043065 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7bq\" (UniqueName: \"kubernetes.io/projected/693ea769-279d-409b-8a8a-cd6dc5c0613d-kube-api-access-cc7bq\") pod \"console-6d76cf487f-9xhfr\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:28.180981 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:28.180950 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:32.038135 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.038108 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-565444cd6f-brxhq"] Jul 09 03:43:32.063856 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.062974 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-565444cd6f-brxhq"] Jul 09 03:43:32.063856 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.063092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.071755 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.071726 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 03:43:32.132151 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.132001 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d76cf487f-9xhfr"] Jul 09 03:43:32.137509 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:32.137487 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693ea769_279d_409b_8a8a_cd6dc5c0613d.slice/crio-a2ab2d0c30a1364e3e0a6bccb909a34df293023ffb381a6b555b5773301838bf WatchSource:0}: Error finding container a2ab2d0c30a1364e3e0a6bccb909a34df293023ffb381a6b555b5773301838bf: Status 404 returned error can't find the container with id a2ab2d0c30a1364e3e0a6bccb909a34df293023ffb381a6b555b5773301838bf Jul 09 03:43:32.169076 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcb7n\" (UniqueName: \"kubernetes.io/projected/5c6dbefc-dddf-4072-ab21-294cd3de3976-kube-api-access-rcb7n\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.169253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-serving-cert\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.169253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-oauth-serving-cert\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.169253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-trusted-ca-bundle\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.169253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-service-ca\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.169475 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-config\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.169475 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.169333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-oauth-config\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270395 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-trusted-ca-bundle\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270395 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-service-ca\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-config\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-oauth-config\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcb7n\" (UniqueName: \"kubernetes.io/projected/5c6dbefc-dddf-4072-ab21-294cd3de3976-kube-api-access-rcb7n\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-serving-cert\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.270794 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.270665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-oauth-serving-cert\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.271265 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.271236 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-service-ca\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.271382 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.271259 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-config\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.271493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.271469 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-trusted-ca-bundle\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.271611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.271585 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-oauth-serving-cert\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.274451 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.274334 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-oauth-config\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.274532 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.274499 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-serving-cert\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.278392 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.278347 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcb7n\" (UniqueName: \"kubernetes.io/projected/5c6dbefc-dddf-4072-ab21-294cd3de3976-kube-api-access-rcb7n\") pod \"console-565444cd6f-brxhq\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.397065 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.397043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:32.550942 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.550875 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-565444cd6f-brxhq"] Jul 09 03:43:32.556717 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:32.556687 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6dbefc_dddf_4072_ab21_294cd3de3976.slice/crio-3d37d5136fa548d53b1728c753db686841e1786ffe37d5e2f0b200648274e53b WatchSource:0}: Error finding container 3d37d5136fa548d53b1728c753db686841e1786ffe37d5e2f0b200648274e53b: Status 404 returned error can't find the container with id 3d37d5136fa548d53b1728c753db686841e1786ffe37d5e2f0b200648274e53b Jul 09 03:43:32.971910 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.971830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ml6k2" event={"ID":"0ec30039-dbd0-4618-b240-5be7fd9f219e","Type":"ContainerStarted","Data":"7c9b6c472bc0bb74b150120fbd15c8e7ad95f7481668219d9c3cde50d6f18200"} Jul 09 03:43:32.973453 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.973392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d76cf487f-9xhfr" event={"ID":"693ea769-279d-409b-8a8a-cd6dc5c0613d","Type":"ContainerStarted","Data":"a2ab2d0c30a1364e3e0a6bccb909a34df293023ffb381a6b555b5773301838bf"} Jul 09 03:43:32.975587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.975563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9h6bv" event={"ID":"4d4df1af-8878-43f4-b212-7271c805b99e","Type":"ContainerStarted","Data":"160f95e0bfa77e509b2ec553916c611272ddb1c79e13a5fca02e2ae733c35768"} Jul 09 03:43:32.975678 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.975606 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9h6bv" event={"ID":"4d4df1af-8878-43f4-b212-7271c805b99e","Type":"ContainerStarted","Data":"3edc7789919a3a37ebfbc6ec276a3f2ff2ea7bb8bd453cce24b0a906b1425a6c"} Jul 09 03:43:32.975749 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.975734 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:32.977415 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.977391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565444cd6f-brxhq" event={"ID":"5c6dbefc-dddf-4072-ab21-294cd3de3976","Type":"ContainerStarted","Data":"3d37d5136fa548d53b1728c753db686841e1786ffe37d5e2f0b200648274e53b"} Jul 09 03:43:32.979214 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.979190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4b998" event={"ID":"999bfc7d-3bba-4a24-9164-4ea904ee6d20","Type":"ContainerStarted","Data":"a5b56369afa8ff9b136fb2227aade1c93f081a64c97bfb459f3eb093499fb5f9"} Jul 09 03:43:32.981368 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.981329 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" event={"ID":"41e4af71-f589-48c0-b40e-d35dc41b419f","Type":"ContainerStarted","Data":"2ad4e15caa63d049a12ea48bb8a89ff87ed0b4985b495a59e3c2f1c070ecac95"} Jul 09 03:43:32.981983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.981966 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:32.987682 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.987662 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" Jul 09 03:43:32.992677 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:32.992228 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9h6bv" podStartSLOduration=2.920029935 podStartE2EDuration="8.992210086s" totalImagesPullingTime="6.072180151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:32.991749914 +0000 UTC m=+53.856360171" watchObservedRunningTime="2026-07-09 03:43:32.992210086 +0000 UTC m=+53.856820340" Jul 09 03:43:33.006490 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:33.006452 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntmrh" podStartSLOduration=2.209729429 podStartE2EDuration="8.006438907s" totalImagesPullingTime="5.796709478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:33.005197521 +0000 UTC m=+53.869807778" watchObservedRunningTime="2026-07-09 03:43:33.006438907 +0000 UTC m=+53.871049164" Jul 09 03:43:33.020033 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:33.019973 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4b998" podStartSLOduration=2.554156993 podStartE2EDuration="9.019960811s" totalImagesPullingTime="6.465803818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:33.019594603 +0000 UTC m=+53.884204860" watchObservedRunningTime="2026-07-09 03:43:33.019960811 +0000 UTC m=+53.884571068" Jul 09 03:43:33.987338 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:33.987297 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ml6k2" event={"ID":"0ec30039-dbd0-4618-b240-5be7fd9f219e","Type":"ContainerStarted","Data":"47900a12d739b1d6f2f0054ea5ff95fda393181c81aa1b8110bfab0e3317d062"} Jul 09 03:43:34.039596 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.038448 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-542jr"] Jul 09 03:43:34.041671 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.040837 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.043571 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.043390 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 03:43:34.046103 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.045831 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n9jqt\"" Jul 09 03:43:34.051021 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.049804 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 03:43:34.051021 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.050504 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 03:43:34.051233 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.051095 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 03:43:34.051233 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.051197 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 03:43:34.053926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.053614 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-542jr"] Jul 09 03:43:34.084400 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.083789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.084400 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.083862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hbpp\" (UniqueName: \"kubernetes.io/projected/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-kube-api-access-9hbpp\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.084400 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.083915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.084400 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.083967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.185619 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.184987 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.185619 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.185039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hbpp\" (UniqueName: \"kubernetes.io/projected/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-kube-api-access-9hbpp\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.185619 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.185074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.185619 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.185115 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.185848 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:34.185672 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 03:43:34.185848 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:34.185733 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-tls podName:f2d2a6f4-ef97-424e-81bd-72542fabf0b1 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:34.685712871 +0000 UTC m=+55.550323122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-542jr" (UID: "f2d2a6f4-ef97-424e-81bd-72542fabf0b1") : secret "prometheus-operator-tls" not found Jul 09 03:43:34.186564 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.186539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.193464 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.193420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.195553 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.195511 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hbpp\" (UniqueName: \"kubernetes.io/projected/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-kube-api-access-9hbpp\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.688649 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.688615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.691445 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.691421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d2a6f4-ef97-424e-81bd-72542fabf0b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-542jr\" (UID: \"f2d2a6f4-ef97-424e-81bd-72542fabf0b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:34.963315 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:34.963243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" Jul 09 03:43:36.883437 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:36.883330 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-542jr"] Jul 09 03:43:36.886284 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:36.886255 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d2a6f4_ef97_424e_81bd_72542fabf0b1.slice/crio-b4d4cf92a1bdf6f5579ba2d9f714291882e186c1064a95ecdfbc7be97f066df1 WatchSource:0}: Error finding container b4d4cf92a1bdf6f5579ba2d9f714291882e186c1064a95ecdfbc7be97f066df1: Status 404 returned error can't find the container with id b4d4cf92a1bdf6f5579ba2d9f714291882e186c1064a95ecdfbc7be97f066df1 Jul 09 03:43:36.999292 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:36.999214 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565444cd6f-brxhq" event={"ID":"5c6dbefc-dddf-4072-ab21-294cd3de3976","Type":"ContainerStarted","Data":"f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9"} Jul 09 03:43:37.000495 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:37.000467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" event={"ID":"f2d2a6f4-ef97-424e-81bd-72542fabf0b1","Type":"ContainerStarted","Data":"b4d4cf92a1bdf6f5579ba2d9f714291882e186c1064a95ecdfbc7be97f066df1"} Jul 09 03:43:37.002304 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:37.002275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ml6k2" event={"ID":"0ec30039-dbd0-4618-b240-5be7fd9f219e","Type":"ContainerStarted","Data":"9da1c26fe9ffa780da878271ebd33a23eb642cfa1eab49d2d945c5b07456e9a3"} Jul 09 03:43:37.003722 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:37.003704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d76cf487f-9xhfr" event={"ID":"693ea769-279d-409b-8a8a-cd6dc5c0613d","Type":"ContainerStarted","Data":"a811e598f2607a3de5d50c34507146d2c543b6adb3d5db1363d5678c91ef495e"} Jul 09 03:43:37.015872 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:37.015699 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-565444cd6f-brxhq" podStartSLOduration=0.810681207 podStartE2EDuration="5.01566418s" totalImagesPullingTime="4.204982973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:37.01534489 +0000 UTC m=+57.879955159" watchObservedRunningTime="2026-07-09 03:43:37.01566418 +0000 UTC m=+57.880274437" Jul 09 03:43:37.031150 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:37.031107 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d76cf487f-9xhfr" podStartSLOduration=5.417726879 podStartE2EDuration="10.031094805s" totalImagesPullingTime="4.613367926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:37.030608967 +0000 UTC m=+57.895219225" watchObservedRunningTime="2026-07-09 03:43:37.031094805 +0000 UTC m=+57.895705040" Jul 09 03:43:37.047300 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:37.047263 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ml6k2" podStartSLOduration=2.05898546 podStartE2EDuration="13.047251806s" totalImagesPullingTime="10.988266346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:43:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:37.046615485 +0000 UTC m=+57.911225744" watchObservedRunningTime="2026-07-09 03:43:37.047251806 +0000 UTC m=+57.911862097" Jul 09 03:43:38.181751 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:38.181708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:38.182189 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:38.181813 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:38.187519 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:38.187497 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:39.012375 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:39.012336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" event={"ID":"f2d2a6f4-ef97-424e-81bd-72542fabf0b1","Type":"ContainerStarted","Data":"ddfed7b5dfd529ffcdcb003cd8298b31773a9b26fec72fd2ee26bb6b22621875"} Jul 09 03:43:39.012518 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:39.012398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" event={"ID":"f2d2a6f4-ef97-424e-81bd-72542fabf0b1","Type":"ContainerStarted","Data":"1c63749a5c8b6d798cd44901e1296b34a3c1e321d0b66d7e76c6864e9a099e4f"} Jul 09 03:43:39.016172 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:39.016148 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:43:39.027520 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:39.027483 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-542jr" podStartSLOduration=3.692169309 podStartE2EDuration="5.027469683s" totalImagesPullingTime="1.335300374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:39.026781109 +0000 UTC m=+59.891391365" watchObservedRunningTime="2026-07-09 03:43:39.027469683 +0000 UTC m=+59.892080074" Jul 09 03:43:40.910550 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:40.910522 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj9l5" Jul 09 03:43:42.397642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:42.397604 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:42.398017 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:42.397688 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:42.402095 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:42.402078 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:42.989850 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:42.989823 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9h6bv" Jul 09 03:43:43.030460 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:43.030430 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:43:43.079829 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:43.079802 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d76cf487f-9xhfr"] Jul 09 03:43:45.393732 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.393683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:45.397548 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.397531 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 03:43:45.406944 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.406923 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71fd99dc-32ba-48c0-98af-e66994b90329-metrics-certs\") pod \"network-metrics-daemon-tdxld\" (UID: \"71fd99dc-32ba-48c0-98af-e66994b90329\") " pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:45.494493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.494465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:45.494630 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.494522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:45.497112 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.497094 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 03:43:45.497167 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.497124 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 03:43:45.507165 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.507140 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 03:43:45.507263 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.507220 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8a5f942-5372-49d7-9688-5a9cf98da450-original-pull-secret\") pod \"global-pull-secret-syncer-j55t4\" (UID: \"c8a5f942-5372-49d7-9688-5a9cf98da450\") " pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:45.517175 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.517158 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prpjn\" (UniqueName: \"kubernetes.io/projected/3bcc4451-be0c-4352-a439-d10fe48d83fe-kube-api-access-prpjn\") pod \"network-check-target-7kv6t\" (UID: \"3bcc4451-be0c-4352-a439-d10fe48d83fe\") " pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:45.576296 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.576271 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-54tq2\"" Jul 09 03:43:45.584190 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.584170 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tdxld" Jul 09 03:43:45.588006 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.587991 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ch8mv\"" Jul 09 03:43:45.593131 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.593106 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j55t4" Jul 09 03:43:45.596187 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.596165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:45.732204 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.732177 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tdxld"] Jul 09 03:43:45.736516 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:45.736489 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fd99dc_32ba_48c0_98af_e66994b90329.slice/crio-636aff45896de5445f3b37d5fcd504d89ef981c1d78fde4f262752ee9b56d7bd WatchSource:0}: Error finding container 636aff45896de5445f3b37d5fcd504d89ef981c1d78fde4f262752ee9b56d7bd: Status 404 returned error can't find the container with id 636aff45896de5445f3b37d5fcd504d89ef981c1d78fde4f262752ee9b56d7bd Jul 09 03:43:45.742892 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.742859 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kv6t"] Jul 09 03:43:45.746229 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:45.746207 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcc4451_be0c_4352_a439_d10fe48d83fe.slice/crio-288ed619327a1b6f9e3e58ae02305961d4b54391f0f6958e3710a4e476baa7f5 WatchSource:0}: Error finding container 288ed619327a1b6f9e3e58ae02305961d4b54391f0f6958e3710a4e476baa7f5: Status 404 returned error can't find the container with id 288ed619327a1b6f9e3e58ae02305961d4b54391f0f6958e3710a4e476baa7f5 Jul 09 03:43:45.761930 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:45.761909 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j55t4"] Jul 09 03:43:45.764240 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:45.764217 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a5f942_5372_49d7_9688_5a9cf98da450.slice/crio-92d67cd80ef8dcc0a70ac0a985e73f2d7e5170295e083da5ca35e400488f1742 WatchSource:0}: Error finding container 92d67cd80ef8dcc0a70ac0a985e73f2d7e5170295e083da5ca35e400488f1742: Status 404 returned error can't find the container with id 92d67cd80ef8dcc0a70ac0a985e73f2d7e5170295e083da5ca35e400488f1742 Jul 09 03:43:46.040455 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:46.040419 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kv6t" event={"ID":"3bcc4451-be0c-4352-a439-d10fe48d83fe","Type":"ContainerStarted","Data":"288ed619327a1b6f9e3e58ae02305961d4b54391f0f6958e3710a4e476baa7f5"} Jul 09 03:43:46.041574 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:46.041553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j55t4" event={"ID":"c8a5f942-5372-49d7-9688-5a9cf98da450","Type":"ContainerStarted","Data":"92d67cd80ef8dcc0a70ac0a985e73f2d7e5170295e083da5ca35e400488f1742"} Jul 09 03:43:46.042605 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:46.042588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tdxld" event={"ID":"71fd99dc-32ba-48c0-98af-e66994b90329","Type":"ContainerStarted","Data":"636aff45896de5445f3b37d5fcd504d89ef981c1d78fde4f262752ee9b56d7bd"} Jul 09 03:43:46.958546 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:46.958508 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-766ffc464c-9vmtx" Jul 09 03:43:47.988418 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:47.988384 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh"] Jul 09 03:43:47.991410 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:47.991384 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:47.993932 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:47.993903 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 03:43:47.993932 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:47.993923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 03:43:47.994099 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:47.994084 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4dc8j\"" Jul 09 03:43:48.007340 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.007318 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh"] Jul 09 03:43:48.011864 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.011836 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nslw9"] Jul 09 03:43:48.014188 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.014168 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.014856 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.014828 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q"] Jul 09 03:43:48.016919 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.016750 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 03:43:48.016919 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.016839 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 03:43:48.016919 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.016889 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 03:43:48.016919 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.016906 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bhfm5\"" Jul 09 03:43:48.017441 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.017421 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.019713 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.019692 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 03:43:48.020080 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.020062 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 03:43:48.020418 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.020062 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9rgx6\"" Jul 09 03:43:48.020418 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.020066 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 03:43:48.030057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.030036 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q"] Jul 09 03:43:48.054886 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.054834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tdxld" event={"ID":"71fd99dc-32ba-48c0-98af-e66994b90329","Type":"ContainerStarted","Data":"87df087ce5625b0e62e26063e5bd696962b9a931158bba59dc50be97956987f1"} Jul 09 03:43:48.054886 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.054885 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tdxld" event={"ID":"71fd99dc-32ba-48c0-98af-e66994b90329","Type":"ContainerStarted","Data":"3bb55c54a4312b16bae744835aaf386f8a1800cdae2665685abb6a88a2d0bc02"} Jul 09 03:43:48.084218 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.084167 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tdxld" podStartSLOduration=67.822953325 podStartE2EDuration="1m9.084147151s" totalImagesPullingTime="1.261193826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:48.08364962 +0000 UTC m=+68.948259880" watchObservedRunningTime="2026-07-09 03:43:48.084147151 +0000 UTC m=+68.948757410" Jul 09 03:43:48.116081 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/513b7bad-fa15-4f51-a9b9-60bce0102413-metrics-client-ca\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116235 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52806272-d79e-4781-bbbd-9f53de96d7bf-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.116235 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52806272-d79e-4781-bbbd-9f53de96d7bf-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.116235 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116213 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-accelerators-collector-config\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116374 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-root\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zzs\" (UniqueName: \"kubernetes.io/projected/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-kube-api-access-s5zzs\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.116447 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-wtmp\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-textfile\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116535 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-sys\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccbn\" (UniqueName: \"kubernetes.io/projected/513b7bad-fa15-4f51-a9b9-60bce0102413-kube-api-access-mccbn\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116680 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-tls\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.116836 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.116711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mvnl\" (UniqueName: \"kubernetes.io/projected/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-api-access-8mvnl\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.218184 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.218352 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.218352 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218352 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-accelerators-collector-config\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218352 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.218352 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-root\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218376 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218408 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zzs\" (UniqueName: \"kubernetes.io/projected/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-kube-api-access-s5zzs\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-wtmp\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-textfile\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-sys\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.218539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccbn\" (UniqueName: \"kubernetes.io/projected/513b7bad-fa15-4f51-a9b9-60bce0102413-kube-api-access-mccbn\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.218962 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:48.218740 2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:48.219026 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-tls podName:52806272-d79e-4781-bbbd-9f53de96d7bf nodeName:}" failed. No retries permitted until 2026-07-09 03:43:48.718903373 +0000 UTC m=+69.583513611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-bbm8q" (UID: "52806272-d79e-4781-bbbd-9f53de96d7bf") : secret "kube-state-metrics-tls" not found Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:48.219031 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-accelerators-collector-config\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:48.219078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-tls podName:9ddaa1b3-2ec6-4665-a109-4289f39b3c35 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:48.71906568 +0000 UTC m=+69.583675916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-cjzbh" (UID: "9ddaa1b3-2ec6-4665-a109-4289f39b3c35") : secret "openshift-state-metrics-tls" not found Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-tls\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mvnl\" (UniqueName: \"kubernetes.io/projected/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-api-access-8mvnl\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219073 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-root\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/513b7bad-fa15-4f51-a9b9-60bce0102413-metrics-client-ca\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52806272-d79e-4781-bbbd-9f53de96d7bf-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52806272-d79e-4781-bbbd-9f53de96d7bf-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.221387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219734 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219785 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-sys\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219865 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-wtmp\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.219948 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52806272-d79e-4781-bbbd-9f53de96d7bf-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.220345 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-textfile\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.220420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/513b7bad-fa15-4f51-a9b9-60bce0102413-metrics-client-ca\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.222046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.220657 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52806272-d79e-4781-bbbd-9f53de96d7bf-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.223146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.223118 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.224178 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.224146 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.224647 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.224620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.226346 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.226324 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/513b7bad-fa15-4f51-a9b9-60bce0102413-node-exporter-tls\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.228216 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.228184 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zzs\" (UniqueName: \"kubernetes.io/projected/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-kube-api-access-s5zzs\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.233493 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.233471 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mvnl\" (UniqueName: \"kubernetes.io/projected/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-api-access-8mvnl\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.234109 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.234049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccbn\" (UniqueName: \"kubernetes.io/projected/513b7bad-fa15-4f51-a9b9-60bce0102413-kube-api-access-mccbn\") pod \"node-exporter-nslw9\" (UID: \"513b7bad-fa15-4f51-a9b9-60bce0102413\") " pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.326821 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.326738 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nslw9" Jul 09 03:43:48.724531 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.724489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.724709 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.724548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.727137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.727111 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ddaa1b3-2ec6-4665-a109-4289f39b3c35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cjzbh\" (UID: \"9ddaa1b3-2ec6-4665-a109-4289f39b3c35\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.727268 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.727117 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52806272-d79e-4781-bbbd-9f53de96d7bf-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bbm8q\" (UID: \"52806272-d79e-4781-bbbd-9f53de96d7bf\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:48.903947 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.903914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" Jul 09 03:43:48.935012 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:48.934974 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" Jul 09 03:43:49.152742 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.152709 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 03:43:49.157189 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.157166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.159658 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.159635 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 03:43:49.159914 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.159892 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 03:43:49.160006 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.159895 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 03:43:49.160192 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160166 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 03:43:49.160298 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160283 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 03:43:49.160540 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160519 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 03:43:49.160636 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160538 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 03:43:49.160636 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160548 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 03:43:49.160728 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160525 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6mbsp\"" Jul 09 03:43:49.160728 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.160661 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 03:43:49.167539 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.167518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 03:43:49.330876 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.330842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.330895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkg69\" (UniqueName: \"kubernetes.io/projected/1e747d34-acd5-44bc-9393-701a3a9e4ce0-kube-api-access-kkg69\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.330921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e747d34-acd5-44bc-9393-701a3a9e4ce0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.330962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.330991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331017 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331057 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e747d34-acd5-44bc-9393-701a3a9e4ce0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331386 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e747d34-acd5-44bc-9393-701a3a9e4ce0-config-out\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331386 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-web-config\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331386 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e747d34-acd5-44bc-9393-701a3a9e4ce0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331386 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331386 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e747d34-acd5-44bc-9393-701a3a9e4ce0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.331386 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.331240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432615 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432521 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432615 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkg69\" (UniqueName: \"kubernetes.io/projected/1e747d34-acd5-44bc-9393-701a3a9e4ce0-kube-api-access-kkg69\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432615 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e747d34-acd5-44bc-9393-701a3a9e4ce0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e747d34-acd5-44bc-9393-701a3a9e4ce0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e747d34-acd5-44bc-9393-701a3a9e4ce0-config-out\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-web-config\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e747d34-acd5-44bc-9393-701a3a9e4ce0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e747d34-acd5-44bc-9393-701a3a9e4ce0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.432916 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.432906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.433446 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.433311 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e747d34-acd5-44bc-9393-701a3a9e4ce0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.434249 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.433606 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e747d34-acd5-44bc-9393-701a3a9e4ce0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.434249 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.434162 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e747d34-acd5-44bc-9393-701a3a9e4ce0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.435849 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.435822 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.436210 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.436187 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-web-config\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.436813 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.436767 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.437214 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.437167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.437315 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.437252 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.437671 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.437640 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.437957 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.437938 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e747d34-acd5-44bc-9393-701a3a9e4ce0-config-out\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.438123 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.438099 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e747d34-acd5-44bc-9393-701a3a9e4ce0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.438314 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.438293 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e747d34-acd5-44bc-9393-701a3a9e4ce0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.444009 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.443990 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkg69\" (UniqueName: \"kubernetes.io/projected/1e747d34-acd5-44bc-9393-701a3a9e4ce0-kube-api-access-kkg69\") pod \"alertmanager-main-0\" (UID: \"1e747d34-acd5-44bc-9393-701a3a9e4ce0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:49.470150 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:49.470123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 03:43:50.653640 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:50.653607 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 03:43:50.656206 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:50.656182 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e747d34_acd5_44bc_9393_701a3a9e4ce0.slice/crio-857cf7f8e5bd4d704b0230be8350a22bfdf544dad91c3342c2d61c2c6db957c9 WatchSource:0}: Error finding container 857cf7f8e5bd4d704b0230be8350a22bfdf544dad91c3342c2d61c2c6db957c9: Status 404 returned error can't find the container with id 857cf7f8e5bd4d704b0230be8350a22bfdf544dad91c3342c2d61c2c6db957c9 Jul 09 03:43:50.871608 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:50.871584 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q"] Jul 09 03:43:50.873959 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:50.873935 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52806272_d79e_4781_bbbd_9f53de96d7bf.slice/crio-835c3f9b775571169684bcd246dc25c62102f107d9270008fac03a1a6f5d68bb WatchSource:0}: Error finding container 835c3f9b775571169684bcd246dc25c62102f107d9270008fac03a1a6f5d68bb: Status 404 returned error can't find the container with id 835c3f9b775571169684bcd246dc25c62102f107d9270008fac03a1a6f5d68bb Jul 09 03:43:50.878715 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:50.878694 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh"] Jul 09 03:43:50.881188 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:50.881160 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ddaa1b3_2ec6_4665_a109_4289f39b3c35.slice/crio-f50fb0449e5028d7aa9108e73aa36f285d2aa505c38a235f387c6632df9ddaba WatchSource:0}: Error finding container f50fb0449e5028d7aa9108e73aa36f285d2aa505c38a235f387c6632df9ddaba: Status 404 returned error can't find the container with id f50fb0449e5028d7aa9108e73aa36f285d2aa505c38a235f387c6632df9ddaba Jul 09 03:43:51.069145 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.069098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kv6t" event={"ID":"3bcc4451-be0c-4352-a439-d10fe48d83fe","Type":"ContainerStarted","Data":"0edb4fdc85a0a25604ef25d42ad2ec1ee86b4b0f74a37b5c74f39127937aa401"} Jul 09 03:43:51.069298 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.069202 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:43:51.071147 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.071114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j55t4" event={"ID":"c8a5f942-5372-49d7-9688-5a9cf98da450","Type":"ContainerStarted","Data":"95b1bd801bf6942918506e81bc5abe20de4bc5e943b4629cadd4d113a8a9ecd7"} Jul 09 03:43:51.072701 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.072677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"857cf7f8e5bd4d704b0230be8350a22bfdf544dad91c3342c2d61c2c6db957c9"} Jul 09 03:43:51.074070 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.074033 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nslw9" event={"ID":"513b7bad-fa15-4f51-a9b9-60bce0102413","Type":"ContainerStarted","Data":"faccec6c1a2502a4f29f96065a11b8a5bd150e51c438c868d564073941166301"} Jul 09 03:43:51.076393 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.076346 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" event={"ID":"9ddaa1b3-2ec6-4665-a109-4289f39b3c35","Type":"ContainerStarted","Data":"7739d368d861d2f4229ec6c516a4ccbecc790c614b51e1f73182c45e9f4e9d84"} Jul 09 03:43:51.076474 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.076422 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" event={"ID":"9ddaa1b3-2ec6-4665-a109-4289f39b3c35","Type":"ContainerStarted","Data":"a6cf02e403b536c1818df62d4e6ed86bd7f82b0a86b9bf4bf92b59ca3c956880"} Jul 09 03:43:51.076474 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.076452 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" event={"ID":"9ddaa1b3-2ec6-4665-a109-4289f39b3c35","Type":"ContainerStarted","Data":"f50fb0449e5028d7aa9108e73aa36f285d2aa505c38a235f387c6632df9ddaba"} Jul 09 03:43:51.076556 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.076487 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw"] Jul 09 03:43:51.079736 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.079704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" event={"ID":"52806272-d79e-4781-bbbd-9f53de96d7bf","Type":"ContainerStarted","Data":"835c3f9b775571169684bcd246dc25c62102f107d9270008fac03a1a6f5d68bb"} Jul 09 03:43:51.079820 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.079797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.082201 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.082177 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 03:43:51.082895 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.082717 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 03:43:51.082895 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.082738 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 03:43:51.082895 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.082817 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 03:43:51.082895 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.082835 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-j6gs7\"" Jul 09 03:43:51.083208 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.083035 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5ea77c7kdpc7m\"" Jul 09 03:43:51.083208 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.083134 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 03:43:51.093421 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.093375 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7kv6t" podStartSLOduration=67.351455513 podStartE2EDuration="1m12.093341602s" totalImagesPullingTime="4.741886089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:51.091893322 +0000 UTC m=+71.956503582" watchObservedRunningTime="2026-07-09 03:43:51.093341602 +0000 UTC m=+71.957951859" Jul 09 03:43:51.097195 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.097168 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw"] Jul 09 03:43:51.126498 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.126410 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j55t4" podStartSLOduration=67.38553997 podStartE2EDuration="1m12.126396361s" totalImagesPullingTime="4.740856391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:51.10828003 +0000 UTC m=+71.972890287" watchObservedRunningTime="2026-07-09 03:43:51.126396361 +0000 UTC m=+71.991006618" Jul 09 03:43:51.249759 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.249717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-tls\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.249926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.249796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.249926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.249834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfm46\" (UniqueName: \"kubernetes.io/projected/4030c25f-816b-4da2-8c96-e0f578e9dc96-kube-api-access-mfm46\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.249926 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.249864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.250061 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.249985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.250099 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.250078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.250157 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.250141 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-grpc-tls\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.250214 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.250194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4030c25f-816b-4da2-8c96-e0f578e9dc96-metrics-client-ca\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351223 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-grpc-tls\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351223 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4030c25f-816b-4da2-8c96-e0f578e9dc96-metrics-client-ca\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351223 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-tls\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351223 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351461 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfm46\" (UniqueName: \"kubernetes.io/projected/4030c25f-816b-4da2-8c96-e0f578e9dc96-kube-api-access-mfm46\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351461 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.351563 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.352022 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.351967 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4030c25f-816b-4da2-8c96-e0f578e9dc96-metrics-client-ca\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.353985 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.353940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.354225 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.354189 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.354225 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.354203 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-tls\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.354345 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.354241 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.354345 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.354332 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.354624 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.354605 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4030c25f-816b-4da2-8c96-e0f578e9dc96-secret-grpc-tls\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.359052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.359028 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfm46\" (UniqueName: \"kubernetes.io/projected/4030c25f-816b-4da2-8c96-e0f578e9dc96-kube-api-access-mfm46\") pod \"thanos-querier-7bcd9b7454-xjbjw\" (UID: \"4030c25f-816b-4da2-8c96-e0f578e9dc96\") " pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.391047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.390980 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:51.545302 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:51.545273 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw"] Jul 09 03:43:51.548943 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:51.548893 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4030c25f_816b_4da2_8c96_e0f578e9dc96.slice/crio-ce32ff7791b0b3ff10e88717934882624f24d7945e895f9f528524be52f8134c WatchSource:0}: Error finding container ce32ff7791b0b3ff10e88717934882624f24d7945e895f9f528524be52f8134c: Status 404 returned error can't find the container with id ce32ff7791b0b3ff10e88717934882624f24d7945e895f9f528524be52f8134c Jul 09 03:43:52.089981 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.089942 2556 generic.go:356] "Generic (PLEG): container finished" podID="513b7bad-fa15-4f51-a9b9-60bce0102413" containerID="ec4aafc6e07704388c3f3162b0ef67eb6da67e5ddc9bd772b106c410d04d5695" exitCode=0 Jul 09 03:43:52.090521 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.090030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nslw9" event={"ID":"513b7bad-fa15-4f51-a9b9-60bce0102413","Type":"ContainerDied","Data":"ec4aafc6e07704388c3f3162b0ef67eb6da67e5ddc9bd772b106c410d04d5695"} Jul 09 03:43:52.091484 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.091449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"ce32ff7791b0b3ff10e88717934882624f24d7945e895f9f528524be52f8134c"} Jul 09 03:43:52.300730 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.300698 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dbf87fb7d-gspbb"] Jul 09 03:43:52.312625 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.312595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.312767 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.312712 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dbf87fb7d-gspbb"] Jul 09 03:43:52.315642 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.315616 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 03:43:52.317532 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.317488 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 03:43:52.317702 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.317681 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4xtcx\"" Jul 09 03:43:52.317778 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.317728 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 03:43:52.317778 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.317764 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 03:43:52.318008 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.317988 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9mj7er4t408a5\"" Jul 09 03:43:52.462146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799nx\" (UniqueName: \"kubernetes.io/projected/470276db-5765-4a7f-90db-2c5b09b05e81-kube-api-access-799nx\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.462146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-secret-metrics-server-tls\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.462399 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462179 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470276db-5765-4a7f-90db-2c5b09b05e81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.462399 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-client-ca-bundle\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.462399 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/470276db-5765-4a7f-90db-2c5b09b05e81-metrics-server-audit-profiles\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.462564 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-secret-metrics-server-client-certs\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.462564 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.462423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/470276db-5765-4a7f-90db-2c5b09b05e81-audit-log\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.563684 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/470276db-5765-4a7f-90db-2c5b09b05e81-metrics-server-audit-profiles\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.563866 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-secret-metrics-server-client-certs\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.563866 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/470276db-5765-4a7f-90db-2c5b09b05e81-audit-log\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.563866 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799nx\" (UniqueName: \"kubernetes.io/projected/470276db-5765-4a7f-90db-2c5b09b05e81-kube-api-access-799nx\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.563866 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-secret-metrics-server-tls\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.563866 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470276db-5765-4a7f-90db-2c5b09b05e81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.564105 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.563875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-client-ca-bundle\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.564430 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.564408 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/470276db-5765-4a7f-90db-2c5b09b05e81-audit-log\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.564672 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.564649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470276db-5765-4a7f-90db-2c5b09b05e81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.564877 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.564851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/470276db-5765-4a7f-90db-2c5b09b05e81-metrics-server-audit-profiles\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.566786 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.566738 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-secret-metrics-server-client-certs\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.566786 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.566764 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-client-ca-bundle\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.566930 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.566835 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/470276db-5765-4a7f-90db-2c5b09b05e81-secret-metrics-server-tls\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.575445 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.575350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-799nx\" (UniqueName: \"kubernetes.io/projected/470276db-5765-4a7f-90db-2c5b09b05e81-kube-api-access-799nx\") pod \"metrics-server-5dbf87fb7d-gspbb\" (UID: \"470276db-5765-4a7f-90db-2c5b09b05e81\") " pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.623770 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.623742 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:43:52.883501 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.883463 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f58c494d9-lmzmw"] Jul 09 03:43:52.905782 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.905754 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd"] Jul 09 03:43:52.905943 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.905899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:52.921978 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.921957 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f58c494d9-lmzmw"] Jul 09 03:43:52.922142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.921991 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd"] Jul 09 03:43:52.922142 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.922056 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:52.926234 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.926212 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 03:43:52.926492 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:52.926234 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qm69c\"" Jul 09 03:43:53.068538 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppmtn\" (UniqueName: \"kubernetes.io/projected/b14aafa7-56e0-4bfc-a9f9-250661e28c90-kube-api-access-ppmtn\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.068709 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-oauth-serving-cert\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.068709 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-service-ca\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.068709 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b14aafa7-56e0-4bfc-a9f9-250661e28c90-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.068869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-oauth-config\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.068869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-serving-cert\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.068869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068813 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-console-config\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.068869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068865 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-trusted-ca-bundle\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.069039 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.068891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjlq9\" (UniqueName: \"kubernetes.io/projected/b6251836-5d27-4a09-ac82-5e4081700d84-kube-api-access-fjlq9\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169453 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-serving-cert\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-console-config\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-trusted-ca-bundle\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjlq9\" (UniqueName: \"kubernetes.io/projected/b6251836-5d27-4a09-ac82-5e4081700d84-kube-api-access-fjlq9\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppmtn\" (UniqueName: \"kubernetes.io/projected/b14aafa7-56e0-4bfc-a9f9-250661e28c90-kube-api-access-ppmtn\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-oauth-serving-cert\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-service-ca\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.169909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169911 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b14aafa7-56e0-4bfc-a9f9-250661e28c90-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.170321 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.169962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-oauth-config\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.170321 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:53.170079 2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 03:43:53.170321 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:43:53.170144 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14aafa7-56e0-4bfc-a9f9-250661e28c90-monitoring-plugin-cert podName:b14aafa7-56e0-4bfc-a9f9-250661e28c90 nodeName:}" failed. No retries permitted until 2026-07-09 03:43:53.670123518 +0000 UTC m=+74.534733754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b14aafa7-56e0-4bfc-a9f9-250661e28c90-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-l6dnd" (UID: "b14aafa7-56e0-4bfc-a9f9-250661e28c90") : secret "monitoring-plugin-cert" not found Jul 09 03:43:53.170321 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.170227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-console-config\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.170587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.170487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-trusted-ca-bundle\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.170587 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.170542 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-oauth-serving-cert\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.170701 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.170655 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-service-ca\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.172350 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.172327 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-serving-cert\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.172594 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.172575 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-oauth-config\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.178725 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.178666 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppmtn\" (UniqueName: \"kubernetes.io/projected/b14aafa7-56e0-4bfc-a9f9-250661e28c90-kube-api-access-ppmtn\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.178968 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.178925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjlq9\" (UniqueName: \"kubernetes.io/projected/b6251836-5d27-4a09-ac82-5e4081700d84-kube-api-access-fjlq9\") pod \"console-7f58c494d9-lmzmw\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.218861 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.218827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:43:53.667932 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.667865 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f58c494d9-lmzmw"] Jul 09 03:43:53.671265 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.671214 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dbf87fb7d-gspbb"] Jul 09 03:43:53.674422 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.673971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b14aafa7-56e0-4bfc-a9f9-250661e28c90-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.679464 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.679415 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b14aafa7-56e0-4bfc-a9f9-250661e28c90-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l6dnd\" (UID: \"b14aafa7-56e0-4bfc-a9f9-250661e28c90\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.681426 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:53.681343 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6251836_5d27_4a09_ac82_5e4081700d84.slice/crio-86c5c2b19711f56be4df1febfaf005b728e2b00f4a4b5cffda0489df141d05cf WatchSource:0}: Error finding container 86c5c2b19711f56be4df1febfaf005b728e2b00f4a4b5cffda0489df141d05cf: Status 404 returned error can't find the container with id 86c5c2b19711f56be4df1febfaf005b728e2b00f4a4b5cffda0489df141d05cf Jul 09 03:43:53.681677 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:53.681656 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470276db_5765_4a7f_90db_2c5b09b05e81.slice/crio-40982dc0d71749607c631b4acf83fa4b53f197dc9398e2d487bb5aaef8481525 WatchSource:0}: Error finding container 40982dc0d71749607c631b4acf83fa4b53f197dc9398e2d487bb5aaef8481525: Status 404 returned error can't find the container with id 40982dc0d71749607c631b4acf83fa4b53f197dc9398e2d487bb5aaef8481525 Jul 09 03:43:53.834351 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.834084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:53.982764 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:53.982570 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd"] Jul 09 03:43:53.987504 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:43:53.987455 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14aafa7_56e0_4bfc_a9f9_250661e28c90.slice/crio-84d704a0ee300acaf67ed86ccc9c5cc3d562d9adf00722a4749bc46356468b3c WatchSource:0}: Error finding container 84d704a0ee300acaf67ed86ccc9c5cc3d562d9adf00722a4749bc46356468b3c: Status 404 returned error can't find the container with id 84d704a0ee300acaf67ed86ccc9c5cc3d562d9adf00722a4749bc46356468b3c Jul 09 03:43:54.104209 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.104026 2556 generic.go:356] "Generic (PLEG): container finished" podID="1e747d34-acd5-44bc-9393-701a3a9e4ce0" containerID="e61e5c632bcabeb164c9586636acc2fcb6dbd25c7ac893c7a2acb1f86a0673a0" exitCode=0 Jul 09 03:43:54.104209 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.104124 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerDied","Data":"e61e5c632bcabeb164c9586636acc2fcb6dbd25c7ac893c7a2acb1f86a0673a0"} Jul 09 03:43:54.107551 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.107520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nslw9" event={"ID":"513b7bad-fa15-4f51-a9b9-60bce0102413","Type":"ContainerStarted","Data":"b6d666bb991aa10a9b90df8bdd0f751ab66765987789c7f9e93e29860de25736"} Jul 09 03:43:54.107644 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.107578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nslw9" event={"ID":"513b7bad-fa15-4f51-a9b9-60bce0102413","Type":"ContainerStarted","Data":"54b30f91ad86ae43bbe731839bdc5a44a9b9be8e3e4cd46126aa00f0409be511"} Jul 09 03:43:54.110327 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.110295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" event={"ID":"52806272-d79e-4781-bbbd-9f53de96d7bf","Type":"ContainerStarted","Data":"408b3ae414e18350d457903bb068973710ab9d9fa845e1a69ee7a6598798ade1"} Jul 09 03:43:54.110448 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.110373 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" event={"ID":"52806272-d79e-4781-bbbd-9f53de96d7bf","Type":"ContainerStarted","Data":"673cdcd6abb81a39044f053cc70e0795dc11d374a1bf82f5923b3e678c64c5b4"} Jul 09 03:43:54.110448 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.110415 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" event={"ID":"52806272-d79e-4781-bbbd-9f53de96d7bf","Type":"ContainerStarted","Data":"4bda310935b79b3864578040e64a3cbaf5db77dcaa60703389ef8ac27e9c0e3d"} Jul 09 03:43:54.113963 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.113919 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" event={"ID":"b14aafa7-56e0-4bfc-a9f9-250661e28c90","Type":"ContainerStarted","Data":"84d704a0ee300acaf67ed86ccc9c5cc3d562d9adf00722a4749bc46356468b3c"} Jul 09 03:43:54.115789 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.115766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f58c494d9-lmzmw" event={"ID":"b6251836-5d27-4a09-ac82-5e4081700d84","Type":"ContainerStarted","Data":"d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c"} Jul 09 03:43:54.115889 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.115805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f58c494d9-lmzmw" event={"ID":"b6251836-5d27-4a09-ac82-5e4081700d84","Type":"ContainerStarted","Data":"86c5c2b19711f56be4df1febfaf005b728e2b00f4a4b5cffda0489df141d05cf"} Jul 09 03:43:54.118210 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.118183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" event={"ID":"9ddaa1b3-2ec6-4665-a109-4289f39b3c35","Type":"ContainerStarted","Data":"2f3e0755782e4c189551f88245b474615e2d9939db90733b06b11268a5382d67"} Jul 09 03:43:54.120004 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.119953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" event={"ID":"470276db-5765-4a7f-90db-2c5b09b05e81","Type":"ContainerStarted","Data":"40982dc0d71749607c631b4acf83fa4b53f197dc9398e2d487bb5aaef8481525"} Jul 09 03:43:54.156281 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.156227 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nslw9" podStartSLOduration=6.165180763 podStartE2EDuration="7.156208368s" totalImagesPullingTime="919.775727ms" totalInitContainerRuntime="71.251878ms" isStatefulPod=true podCreationTimestamp="2026-07-09 03:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:54.156105023 +0000 UTC m=+75.020715292" watchObservedRunningTime="2026-07-09 03:43:54.156208368 +0000 UTC m=+75.020818624" Jul 09 03:43:54.178567 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.178512 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bbm8q" podStartSLOduration=4.585125496 podStartE2EDuration="7.178491869s" totalImagesPullingTime="2.593366373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:54.177989271 +0000 UTC m=+75.042599533" watchObservedRunningTime="2026-07-09 03:43:54.178491869 +0000 UTC m=+75.043102127" Jul 09 03:43:54.217659 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.217599 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cjzbh" podStartSLOduration=4.74728866 podStartE2EDuration="7.217579022s" totalImagesPullingTime="2.470290362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:54.216372836 +0000 UTC m=+75.080983090" watchObservedRunningTime="2026-07-09 03:43:54.217579022 +0000 UTC m=+75.082189281" Jul 09 03:43:54.217845 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.217705 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f58c494d9-lmzmw" podStartSLOduration=2.217699704 podStartE2EDuration="2.217699704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:54.195388145 +0000 UTC m=+75.059998403" watchObservedRunningTime="2026-07-09 03:43:54.217699704 +0000 UTC m=+75.082309959" Jul 09 03:43:54.298059 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.297973 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 03:43:54.302721 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.302696 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.305171 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305147 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pjgtc\"" Jul 09 03:43:54.305284 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305139 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1l3vihprjare4\"" Jul 09 03:43:54.305284 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305199 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 03:43:54.305677 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305577 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 03:43:54.305781 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305734 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 03:43:54.305849 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305817 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 03:43:54.305923 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.305867 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 03:43:54.306081 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306035 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 03:43:54.306081 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306055 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 03:43:54.306217 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306137 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 03:43:54.306968 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306660 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 03:43:54.306968 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306749 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 03:43:54.306968 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306763 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 03:43:54.306968 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306805 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 03:43:54.306968 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.306867 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 03:43:54.308772 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.308750 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 03:43:54.326946 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.326921 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 03:43:54.487503 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487384 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487503 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-config\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.487727 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487802 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487910 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488007 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.487994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488437 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.488022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488437 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.488050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnmqw\" (UniqueName: \"kubernetes.io/projected/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-kube-api-access-dnmqw\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.488437 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.488078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589208 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589208 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589514 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589584 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589584 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589690 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589690 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589690 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589832 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589832 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589832 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnmqw\" (UniqueName: \"kubernetes.io/projected/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-kube-api-access-dnmqw\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589832 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.589832 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.589992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-config\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.590064 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.590036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.592478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.591742 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.592478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.591778 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.592478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.592100 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.592478 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.592475 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.592739 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.592534 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.593049 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.592953 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.595088 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.593303 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.595088 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.593539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.595088 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.595047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.595628 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.595573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.595628 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.595572 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.599740 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.598889 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnmqw\" (UniqueName: \"kubernetes.io/projected/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-kube-api-access-dnmqw\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.599740 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.599295 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.599740 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.599534 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.599740 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.599698 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-config\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.599982 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.599785 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.600392 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.600046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.600701 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.600665 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.601145 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.601094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.601145 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.601106 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.616309 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.616217 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:43:54.846112 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:54.846087 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 03:43:55.129976 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:55.129891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"a841f6335ad0104257c566ac6b8f3305489c1f4eabbc784ba5222181f33ab64a"} Jul 09 03:43:55.130140 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:55.129983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"af06ba20fea9f710c451f674182f7a85d044cba913093100762e886e771387a4"} Jul 09 03:43:55.130140 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:55.130034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"ec135179b0410e49bf51234855d9cfd1411749fe2183d459fbb8346bd5d4b2f7"} Jul 09 03:43:55.135654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:55.134683 2556 generic.go:356] "Generic (PLEG): container finished" podID="bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4" containerID="c1abe432b359cacfa850b15cb3a30980e5d99542edc03ce7a607b9547ff93f10" exitCode=0 Jul 09 03:43:55.135654 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:55.135611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerDied","Data":"c1abe432b359cacfa850b15cb3a30980e5d99542edc03ce7a607b9547ff93f10"} Jul 09 03:43:55.135858 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:55.135689 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"e4189364bbcccf0db1a236ebbf1ba39a2ff2b7a6df079733ef5c073eac7f0f72"} Jul 09 03:43:57.148491 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.147982 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" event={"ID":"470276db-5765-4a7f-90db-2c5b09b05e81","Type":"ContainerStarted","Data":"a90e41aeacb6e8a9ac6aea5717181d5e5de8f55a9b71c7a927630007e3235c35"} Jul 09 03:43:57.152382 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.152262 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"38084d7028567137da7961eef6517f9d2e8effe8c344e5b060c124346507d4cc"} Jul 09 03:43:57.152382 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.152338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"81b2a9bc8885eff0aad681dc20d71c64c199449906afe429297828e037840528"} Jul 09 03:43:57.152646 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.152398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"312ff5540d15f2abfbd89ffc4596116ebeeceb835e2278f8b84c8603b4bfe315"} Jul 09 03:43:57.157205 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.157178 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"0b3510d5cc13232ee4d4874eaa8ad78d98bdfd837c7341588b74030e5dc3addb"} Jul 09 03:43:57.157319 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.157251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"772f5e0e372eef80eed6c9b14d76d132591d720644ea968ca8b4f48925627407"} Jul 09 03:43:57.157319 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.157289 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" event={"ID":"4030c25f-816b-4da2-8c96-e0f578e9dc96","Type":"ContainerStarted","Data":"8be0e62aca70fb36ead3e2d7239c1c8c22f08ed22538f49b26caf9f89f962efe"} Jul 09 03:43:57.157697 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.157678 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:43:57.160261 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.160181 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" event={"ID":"b14aafa7-56e0-4bfc-a9f9-250661e28c90","Type":"ContainerStarted","Data":"d752c08a0f5d85beca85c3dc1528d6809bae74952ab13d9ef2a01d023d8bea9e"} Jul 09 03:43:57.160936 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.160889 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:57.169059 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.169041 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" Jul 09 03:43:57.176963 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.176885 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" podStartSLOduration=2.015716706 podStartE2EDuration="5.176866677s" totalImagesPullingTime="3.161149971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:57.175525874 +0000 UTC m=+78.040136131" watchObservedRunningTime="2026-07-09 03:43:57.176866677 +0000 UTC m=+78.041476925" Jul 09 03:43:57.206103 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.206057 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" podStartSLOduration=1.058099116 podStartE2EDuration="6.20603835s" totalImagesPullingTime="5.147939234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:57.203478622 +0000 UTC m=+78.068088874" watchObservedRunningTime="2026-07-09 03:43:57.20603835 +0000 UTC m=+78.070648606" Jul 09 03:43:57.224891 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:57.224825 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l6dnd" podStartSLOduration=2.368183634 podStartE2EDuration="5.224805534s" totalImagesPullingTime="2.8566219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:57.221532452 +0000 UTC m=+78.086142709" watchObservedRunningTime="2026-07-09 03:43:57.224805534 +0000 UTC m=+78.089415792" Jul 09 03:43:58.169715 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:58.169666 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"9a6944b59ffa7fb0a1daf7a391b8dd94e58f2028f843f625920a293fba4db556"} Jul 09 03:43:58.170135 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:58.169754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"0a812ef8e3193b7b3476f4a1cac930889d560b8c5bc27f91a1683ccbb1fd01bb"} Jul 09 03:43:58.170135 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:58.169792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e747d34-acd5-44bc-9393-701a3a9e4ce0","Type":"ContainerStarted","Data":"b19816a82618d29f366be5be808d62d35b1f79042ae7d84f16f27960e90f403d"} Jul 09 03:43:58.194821 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:43:58.194767 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.6139848409999997 podStartE2EDuration="9.194747768s" totalImagesPullingTime="5.551196244s" totalInitContainerRuntime="29.566683ms" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:43:58.193349682 +0000 UTC m=+79.057959939" watchObservedRunningTime="2026-07-09 03:43:58.194747768 +0000 UTC m=+79.059358033" Jul 09 03:44:00.181428 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:00.181401 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"204dc61686984f9c03dd53879e4fe82c42d9d5e637c087c579216a69008e4988"} Jul 09 03:44:00.181706 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:00.181466 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"646534fe9c534dda9cc77afe13a38df863a4521394c20ad9687c077869902825"} Jul 09 03:44:00.181706 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:00.181492 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"ed621532c04c6ffc1fe3d0bf1cf49fb1d081c60fc4528775e0454279d350cc66"} Jul 09 03:44:00.181706 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:00.181517 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"66d683f89838393a7ed3df0d692cbd188f2d5367778ea2840f6f62adb2c11717"} Jul 09 03:44:00.181706 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:00.181539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"2ae65b73961497a046223ca3817a4f570c3dd91f26a9b4fd47bb2e4c8acaa51b"} Jul 09 03:44:01.189163 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:01.189128 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4","Type":"ContainerStarted","Data":"41cd4e7b46591d66b58cd9d52a1a0a0e842d1468c0677f4a646c2d38f31aa50d"} Jul 09 03:44:01.220258 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:01.220213 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.864766704 podStartE2EDuration="7.220198686s" totalImagesPullingTime="4.326150864s" totalInitContainerRuntime="29.281118ms" isStatefulPod=false podCreationTimestamp="2026-07-09 03:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:44:01.217612057 +0000 UTC m=+82.082222315" watchObservedRunningTime="2026-07-09 03:44:01.220198686 +0000 UTC m=+82.084808942" Jul 09 03:44:03.176015 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:03.175918 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bcd9b7454-xjbjw" Jul 09 03:44:03.220011 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:03.219984 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:44:03.220133 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:03.220034 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:44:03.225459 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:03.225439 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:44:04.207194 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:04.207168 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:44:04.252081 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:04.252042 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-565444cd6f-brxhq"] Jul 09 03:44:04.616832 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:04.616746 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:44:08.099097 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.099057 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d76cf487f-9xhfr" podUID="693ea769-279d-409b-8a8a-cd6dc5c0613d" containerName="console" containerID="cri-o://a811e598f2607a3de5d50c34507146d2c543b6adb3d5db1363d5678c91ef495e" gracePeriod=15 Jul 09 03:44:08.219846 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.219811 2556 generic.go:356] "Generic (PLEG): container finished" podID="693ea769-279d-409b-8a8a-cd6dc5c0613d" containerID="a811e598f2607a3de5d50c34507146d2c543b6adb3d5db1363d5678c91ef495e" exitCode=0 Jul 09 03:44:08.219951 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.219884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d76cf487f-9xhfr" event={"ID":"693ea769-279d-409b-8a8a-cd6dc5c0613d","Type":"ContainerDied","Data":"a811e598f2607a3de5d50c34507146d2c543b6adb3d5db1363d5678c91ef495e"} Jul 09 03:44:08.344021 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.344001 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:44:08.431793 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.431764 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc7bq\" (UniqueName: \"kubernetes.io/projected/693ea769-279d-409b-8a8a-cd6dc5c0613d-kube-api-access-cc7bq\") pod \"693ea769-279d-409b-8a8a-cd6dc5c0613d\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " Jul 09 03:44:08.431995 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.431799 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-serving-cert\") pod \"693ea769-279d-409b-8a8a-cd6dc5c0613d\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " Jul 09 03:44:08.431995 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.431832 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-oauth-config\") pod \"693ea769-279d-409b-8a8a-cd6dc5c0613d\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " Jul 09 03:44:08.431995 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.431873 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-config\") pod \"693ea769-279d-409b-8a8a-cd6dc5c0613d\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " Jul 09 03:44:08.431995 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.431979 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-oauth-serving-cert\") pod \"693ea769-279d-409b-8a8a-cd6dc5c0613d\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " Jul 09 03:44:08.432206 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.432000 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-service-ca\") pod \"693ea769-279d-409b-8a8a-cd6dc5c0613d\" (UID: \"693ea769-279d-409b-8a8a-cd6dc5c0613d\") " Jul 09 03:44:08.432397 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.432342 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "693ea769-279d-409b-8a8a-cd6dc5c0613d" (UID: "693ea769-279d-409b-8a8a-cd6dc5c0613d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:08.432397 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.432353 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-config" (OuterVolumeSpecName: "console-config") pod "693ea769-279d-409b-8a8a-cd6dc5c0613d" (UID: "693ea769-279d-409b-8a8a-cd6dc5c0613d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:08.432546 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.432407 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-service-ca" (OuterVolumeSpecName: "service-ca") pod "693ea769-279d-409b-8a8a-cd6dc5c0613d" (UID: "693ea769-279d-409b-8a8a-cd6dc5c0613d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:08.434137 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.434115 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693ea769-279d-409b-8a8a-cd6dc5c0613d-kube-api-access-cc7bq" (OuterVolumeSpecName: "kube-api-access-cc7bq") pod "693ea769-279d-409b-8a8a-cd6dc5c0613d" (UID: "693ea769-279d-409b-8a8a-cd6dc5c0613d"). InnerVolumeSpecName "kube-api-access-cc7bq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:44:08.434402 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.434381 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "693ea769-279d-409b-8a8a-cd6dc5c0613d" (UID: "693ea769-279d-409b-8a8a-cd6dc5c0613d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:44:08.434503 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.434482 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "693ea769-279d-409b-8a8a-cd6dc5c0613d" (UID: "693ea769-279d-409b-8a8a-cd6dc5c0613d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:44:08.533598 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.533574 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-oauth-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:08.533598 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.533593 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:08.533598 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.533603 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc7bq\" (UniqueName: \"kubernetes.io/projected/693ea769-279d-409b-8a8a-cd6dc5c0613d-kube-api-access-cc7bq\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:08.533755 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.533613 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:08.533755 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.533623 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-oauth-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:08.533755 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:08.533631 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693ea769-279d-409b-8a8a-cd6dc5c0613d-console-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:09.224776 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:09.224744 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d76cf487f-9xhfr" event={"ID":"693ea769-279d-409b-8a8a-cd6dc5c0613d","Type":"ContainerDied","Data":"a2ab2d0c30a1364e3e0a6bccb909a34df293023ffb381a6b555b5773301838bf"} Jul 09 03:44:09.224776 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:09.224760 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d76cf487f-9xhfr" Jul 09 03:44:09.225236 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:09.224797 2556 scope.go:117] "RemoveContainer" containerID="a811e598f2607a3de5d50c34507146d2c543b6adb3d5db1363d5678c91ef495e" Jul 09 03:44:09.247861 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:09.247832 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d76cf487f-9xhfr"] Jul 09 03:44:09.251419 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:09.251396 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d76cf487f-9xhfr"] Jul 09 03:44:09.661414 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:09.661382 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693ea769-279d-409b-8a8a-cd6dc5c0613d" path="/var/lib/kubelet/pods/693ea769-279d-409b-8a8a-cd6dc5c0613d/volumes" Jul 09 03:44:12.623963 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:12.623921 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:44:12.624314 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:12.624017 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:44:22.093889 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:22.093860 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7kv6t" Jul 09 03:44:29.280234 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:29.280173 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-565444cd6f-brxhq" podUID="5c6dbefc-dddf-4072-ab21-294cd3de3976" containerName="console" containerID="cri-o://f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9" gracePeriod=15 Jul 09 03:44:30.111402 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.111343 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:44:30.244219 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.244179 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-service-ca\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.244512 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.244491 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcb7n\" (UniqueName: \"kubernetes.io/projected/5c6dbefc-dddf-4072-ab21-294cd3de3976-kube-api-access-rcb7n\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.244687 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.244671 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-trusted-ca-bundle\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.244815 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.244799 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-oauth-config\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.244987 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.244960 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-config\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.245129 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.245114 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-oauth-serving-cert\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.245251 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.245237 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-serving-cert\") pod \"5c6dbefc-dddf-4072-ab21-294cd3de3976\" (UID: \"5c6dbefc-dddf-4072-ab21-294cd3de3976\") " Jul 09 03:44:30.246494 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.246464 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:30.246872 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.246851 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:30.247905 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.247653 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-config" (OuterVolumeSpecName: "console-config") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:30.248278 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.248256 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:44:30.257910 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.257870 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:44:30.258954 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.258926 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:44:30.260496 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.260465 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6dbefc-dddf-4072-ab21-294cd3de3976-kube-api-access-rcb7n" (OuterVolumeSpecName: "kube-api-access-rcb7n") pod "5c6dbefc-dddf-4072-ab21-294cd3de3976" (UID: "5c6dbefc-dddf-4072-ab21-294cd3de3976"). InnerVolumeSpecName "kube-api-access-rcb7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:44:30.313626 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.313594 2556 generic.go:356] "Generic (PLEG): container finished" podID="5c6dbefc-dddf-4072-ab21-294cd3de3976" containerID="f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9" exitCode=0 Jul 09 03:44:30.313998 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.313633 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565444cd6f-brxhq" Jul 09 03:44:30.313998 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.313676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565444cd6f-brxhq" event={"ID":"5c6dbefc-dddf-4072-ab21-294cd3de3976","Type":"ContainerDied","Data":"f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9"} Jul 09 03:44:30.313998 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.313729 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565444cd6f-brxhq" event={"ID":"5c6dbefc-dddf-4072-ab21-294cd3de3976","Type":"ContainerDied","Data":"3d37d5136fa548d53b1728c753db686841e1786ffe37d5e2f0b200648274e53b"} Jul 09 03:44:30.313998 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.313750 2556 scope.go:117] "RemoveContainer" containerID="f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9" Jul 09 03:44:30.322847 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.322829 2556 scope.go:117] "RemoveContainer" containerID="f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9" Jul 09 03:44:30.323094 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:44:30.323074 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9\": container with ID starting with f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9 not found: ID does not exist" containerID="f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9" Jul 09 03:44:30.323132 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.323101 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9"} err="failed to get container status \"f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9\": rpc error: code = NotFound desc = could not find container \"f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9\": container with ID starting with f96a2fa4342f2d74d082c65fad910a15010f605bfea25a33b88f3ec7ab32a6d9 not found: ID does not exist" Jul 09 03:44:30.334794 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.334770 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-565444cd6f-brxhq"] Jul 09 03:44:30.339421 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.338593 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-565444cd6f-brxhq"] Jul 09 03:44:30.346158 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346137 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-oauth-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:30.346158 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346159 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:30.346329 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346169 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:30.346329 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346178 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcb7n\" (UniqueName: \"kubernetes.io/projected/5c6dbefc-dddf-4072-ab21-294cd3de3976-kube-api-access-rcb7n\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:30.346329 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346187 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-trusted-ca-bundle\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:30.346329 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346195 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-oauth-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:30.346329 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:30.346203 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c6dbefc-dddf-4072-ab21-294cd3de3976-console-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:44:31.661209 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:31.661173 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6dbefc-dddf-4072-ab21-294cd3de3976" path="/var/lib/kubelet/pods/5c6dbefc-dddf-4072-ab21-294cd3de3976/volumes" Jul 09 03:44:32.629274 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:32.629244 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:44:32.632927 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:32.632906 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dbf87fb7d-gspbb" Jul 09 03:44:54.617322 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:54.617283 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:44:54.636775 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:54.636747 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:44:55.432283 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:44:55.432258 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 03:45:18.260462 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260428 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c7b95698f-4c97q"] Jul 09 03:45:18.260848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260736 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693ea769-279d-409b-8a8a-cd6dc5c0613d" containerName="console" Jul 09 03:45:18.260848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260747 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="693ea769-279d-409b-8a8a-cd6dc5c0613d" containerName="console" Jul 09 03:45:18.260848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260766 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6dbefc-dddf-4072-ab21-294cd3de3976" containerName="console" Jul 09 03:45:18.260848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260772 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6dbefc-dddf-4072-ab21-294cd3de3976" containerName="console" Jul 09 03:45:18.260848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260829 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="693ea769-279d-409b-8a8a-cd6dc5c0613d" containerName="console" Jul 09 03:45:18.260848 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.260840 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6dbefc-dddf-4072-ab21-294cd3de3976" containerName="console" Jul 09 03:45:18.262930 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.262912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.272813 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.272788 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7b95698f-4c97q"] Jul 09 03:45:18.423067 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-service-ca\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.423214 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-oauth-config\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.423214 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-config\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.423214 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-trusted-ca-bundle\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.423312 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423241 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-serving-cert\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.423312 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-oauth-serving-cert\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.423312 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.423299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tgx4\" (UniqueName: \"kubernetes.io/projected/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-kube-api-access-9tgx4\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524218 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-serving-cert\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524218 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-oauth-serving-cert\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524218 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tgx4\" (UniqueName: \"kubernetes.io/projected/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-kube-api-access-9tgx4\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524411 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-service-ca\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524411 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-oauth-config\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524411 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-config\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524411 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-trusted-ca-bundle\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.524994 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.524968 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-oauth-serving-cert\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.525132 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.525006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-config\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.525132 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.525037 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-service-ca\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.525342 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.525317 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-trusted-ca-bundle\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.526737 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.526716 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-oauth-config\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.526839 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.526821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-serving-cert\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.531957 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.531931 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tgx4\" (UniqueName: \"kubernetes.io/projected/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-kube-api-access-9tgx4\") pod \"console-c7b95698f-4c97q\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.572398 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.572349 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:18.693425 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:18.693402 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7b95698f-4c97q"] Jul 09 03:45:18.695252 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:45:18.695215 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4a1d6b_c5e4_4f97_8d67_9acbebc2ad00.slice/crio-dbada0efcc13f2650b6bac36c29f1033c6b6a15360361585c57c5a10539e8d1f WatchSource:0}: Error finding container dbada0efcc13f2650b6bac36c29f1033c6b6a15360361585c57c5a10539e8d1f: Status 404 returned error can't find the container with id dbada0efcc13f2650b6bac36c29f1033c6b6a15360361585c57c5a10539e8d1f Jul 09 03:45:19.515345 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:19.515315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7b95698f-4c97q" event={"ID":"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00","Type":"ContainerStarted","Data":"4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e"} Jul 09 03:45:19.515703 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:19.515371 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7b95698f-4c97q" event={"ID":"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00","Type":"ContainerStarted","Data":"dbada0efcc13f2650b6bac36c29f1033c6b6a15360361585c57c5a10539e8d1f"} Jul 09 03:45:19.532572 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:19.532528 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c7b95698f-4c97q" podStartSLOduration=1.5325133690000001 podStartE2EDuration="1.532513369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:45:19.531666924 +0000 UTC m=+160.396277180" watchObservedRunningTime="2026-07-09 03:45:19.532513369 +0000 UTC m=+160.397123624" Jul 09 03:45:24.040341 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.040306 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c7b95698f-4c97q"] Jul 09 03:45:24.069503 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.069480 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9d88fc75-r7w6g"] Jul 09 03:45:24.071768 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.071751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.082172 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.082151 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9d88fc75-r7w6g"] Jul 09 03:45:24.173084 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-serving-cert\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.173084 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-service-ca\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.173239 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdj29\" (UniqueName: \"kubernetes.io/projected/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-kube-api-access-vdj29\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.173239 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-oauth-config\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.173318 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-config\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.173318 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173300 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-oauth-serving-cert\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.173414 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.173322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-trusted-ca-bundle\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.278845 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.278811 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdj29\" (UniqueName: \"kubernetes.io/projected/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-kube-api-access-vdj29\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.279089 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-oauth-config\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.279323 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-config\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.279485 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-oauth-serving-cert\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.279565 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-trusted-ca-bundle\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.279565 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-serving-cert\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.279669 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-service-ca\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.280000 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.279977 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-config\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.280190 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.280150 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-oauth-serving-cert\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.280263 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.280235 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-service-ca\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.280263 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.280251 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-trusted-ca-bundle\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.281873 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.281854 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-oauth-config\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.282321 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.282302 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-console-serving-cert\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.286704 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.286681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdj29\" (UniqueName: \"kubernetes.io/projected/9a5cdef7-bdd5-4da5-a257-7cbe9d21402f-kube-api-access-vdj29\") pod \"console-6b9d88fc75-r7w6g\" (UID: \"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f\") " pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.381640 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.381586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:24.519102 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.519078 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9d88fc75-r7w6g"] Jul 09 03:45:24.521692 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:45:24.521665 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5cdef7_bdd5_4da5_a257_7cbe9d21402f.slice/crio-1ad133a3304ca16eb09125443ea3198178b013fcbb6b4a9515d34f498b611d71 WatchSource:0}: Error finding container 1ad133a3304ca16eb09125443ea3198178b013fcbb6b4a9515d34f498b611d71: Status 404 returned error can't find the container with id 1ad133a3304ca16eb09125443ea3198178b013fcbb6b4a9515d34f498b611d71 Jul 09 03:45:24.538166 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:24.538142 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d88fc75-r7w6g" event={"ID":"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f","Type":"ContainerStarted","Data":"1ad133a3304ca16eb09125443ea3198178b013fcbb6b4a9515d34f498b611d71"} Jul 09 03:45:25.544412 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:25.544379 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d88fc75-r7w6g" event={"ID":"9a5cdef7-bdd5-4da5-a257-7cbe9d21402f","Type":"ContainerStarted","Data":"4d7d11f58e9f3b3130e699da153f21ab4748679316de5176eec02a4ab1cf597c"} Jul 09 03:45:25.562062 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:25.562019 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9d88fc75-r7w6g" podStartSLOduration=1.562002976 podStartE2EDuration="1.562002976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:45:25.560748046 +0000 UTC m=+166.425358302" watchObservedRunningTime="2026-07-09 03:45:25.562002976 +0000 UTC m=+166.426613234" Jul 09 03:45:28.573471 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:28.573442 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:34.382147 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:34.382065 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:34.382147 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:34.382122 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:34.386677 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:34.386654 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:34.584983 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:34.584952 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9d88fc75-r7w6g" Jul 09 03:45:34.627793 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:34.627763 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f58c494d9-lmzmw"] Jul 09 03:45:49.060032 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.059993 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c7b95698f-4c97q" podUID="6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" containerName="console" containerID="cri-o://4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e" gracePeriod=15 Jul 09 03:45:49.301845 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.301823 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:49.397737 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397669 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-service-ca\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.397869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397714 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-serving-cert\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.397869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397800 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-trusted-ca-bundle\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.397869 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397865 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tgx4\" (UniqueName: \"kubernetes.io/projected/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-kube-api-access-9tgx4\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.398040 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397909 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-oauth-config\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.398040 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397957 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-oauth-serving-cert\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.398040 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.397992 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-config\") pod \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\" (UID: \"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00\") " Jul 09 03:45:49.398191 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.398129 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:45:49.398374 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.398252 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:45:49.398499 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.398313 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.398499 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.398328 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:45:49.398499 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.398408 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-config" (OuterVolumeSpecName: "console-config") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:45:49.399852 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.399829 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-kube-api-access-9tgx4" (OuterVolumeSpecName: "kube-api-access-9tgx4") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "kube-api-access-9tgx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:45:49.400251 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.400230 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:45:49.400303 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.400255 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" (UID: "6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:45:49.499742 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.499717 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tgx4\" (UniqueName: \"kubernetes.io/projected/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-kube-api-access-9tgx4\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.499742 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.499739 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-oauth-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.499870 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.499748 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-oauth-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.499870 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.499757 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.499870 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.499766 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-console-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.499870 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.499774 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00-trusted-ca-bundle\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:45:49.646181 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.646153 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" containerID="4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e" exitCode=0 Jul 09 03:45:49.646274 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.646197 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7b95698f-4c97q" Jul 09 03:45:49.646274 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.646203 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7b95698f-4c97q" event={"ID":"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00","Type":"ContainerDied","Data":"4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e"} Jul 09 03:45:49.646274 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.646247 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7b95698f-4c97q" event={"ID":"6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00","Type":"ContainerDied","Data":"dbada0efcc13f2650b6bac36c29f1033c6b6a15360361585c57c5a10539e8d1f"} Jul 09 03:45:49.646274 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.646268 2556 scope.go:117] "RemoveContainer" containerID="4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e" Jul 09 03:45:49.654070 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.654054 2556 scope.go:117] "RemoveContainer" containerID="4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e" Jul 09 03:45:49.654306 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:45:49.654289 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e\": container with ID starting with 4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e not found: ID does not exist" containerID="4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e" Jul 09 03:45:49.654350 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.654315 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e"} err="failed to get container status \"4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e\": rpc error: code = NotFound desc = could not find container \"4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e\": container with ID starting with 4d3e0670765ad412816b71d679597aa117952f30b908c7a2074756ea2c3fe68e not found: ID does not exist" Jul 09 03:45:49.666128 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.666104 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c7b95698f-4c97q"] Jul 09 03:45:49.668040 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:49.668021 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c7b95698f-4c97q"] Jul 09 03:45:51.661643 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:51.661605 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" path="/var/lib/kubelet/pods/6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00/volumes" Jul 09 03:45:59.648559 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:59.648516 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f58c494d9-lmzmw" podUID="b6251836-5d27-4a09-ac82-5e4081700d84" containerName="console" containerID="cri-o://d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c" gracePeriod=15 Jul 09 03:45:59.893518 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:45:59.893490 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:46:00.084420 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084342 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-oauth-serving-cert\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084420 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084394 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-serving-cert\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084420 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084411 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-console-config\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084668 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084440 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-oauth-config\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084668 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084463 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjlq9\" (UniqueName: \"kubernetes.io/projected/b6251836-5d27-4a09-ac82-5e4081700d84-kube-api-access-fjlq9\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084668 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084503 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-service-ca\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084668 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084523 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-trusted-ca-bundle\") pod \"b6251836-5d27-4a09-ac82-5e4081700d84\" (UID: \"b6251836-5d27-4a09-ac82-5e4081700d84\") " Jul 09 03:46:00.084865 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084840 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-console-config" (OuterVolumeSpecName: "console-config") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:46:00.084865 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084740 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:46:00.084980 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.084884 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:46:00.085149 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.085129 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:46:00.086585 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.086551 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6251836-5d27-4a09-ac82-5e4081700d84-kube-api-access-fjlq9" (OuterVolumeSpecName: "kube-api-access-fjlq9") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "kube-api-access-fjlq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:46:00.086674 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.086606 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:46:00.086674 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.086618 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6251836-5d27-4a09-ac82-5e4081700d84" (UID: "b6251836-5d27-4a09-ac82-5e4081700d84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:46:00.185669 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185641 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-oauth-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.185669 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185666 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-serving-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.185669 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185676 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-console-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.185904 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185684 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6251836-5d27-4a09-ac82-5e4081700d84-console-oauth-config\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.185904 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185692 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjlq9\" (UniqueName: \"kubernetes.io/projected/b6251836-5d27-4a09-ac82-5e4081700d84-kube-api-access-fjlq9\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.185904 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185701 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.185904 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.185709 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6251836-5d27-4a09-ac82-5e4081700d84-trusted-ca-bundle\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:46:00.694880 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.694847 2556 generic.go:356] "Generic (PLEG): container finished" podID="b6251836-5d27-4a09-ac82-5e4081700d84" containerID="d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c" exitCode=0 Jul 09 03:46:00.695322 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.694892 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f58c494d9-lmzmw" Jul 09 03:46:00.695322 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.694915 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f58c494d9-lmzmw" event={"ID":"b6251836-5d27-4a09-ac82-5e4081700d84","Type":"ContainerDied","Data":"d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c"} Jul 09 03:46:00.695322 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.694961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f58c494d9-lmzmw" event={"ID":"b6251836-5d27-4a09-ac82-5e4081700d84","Type":"ContainerDied","Data":"86c5c2b19711f56be4df1febfaf005b728e2b00f4a4b5cffda0489df141d05cf"} Jul 09 03:46:00.695322 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.694991 2556 scope.go:117] "RemoveContainer" containerID="d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c" Jul 09 03:46:00.705674 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.705658 2556 scope.go:117] "RemoveContainer" containerID="d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c" Jul 09 03:46:00.705941 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:46:00.705923 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c\": container with ID starting with d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c not found: ID does not exist" containerID="d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c" Jul 09 03:46:00.705988 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.705949 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c"} err="failed to get container status \"d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c\": rpc error: code = NotFound desc = could not find container \"d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c\": container with ID starting with d4bc92adde6b9416aed2a66ba103ba6836729d6c27467394438dcbc4b1a5336c not found: ID does not exist" Jul 09 03:46:00.718164 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.718142 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f58c494d9-lmzmw"] Jul 09 03:46:00.721405 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:00.721382 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f58c494d9-lmzmw"] Jul 09 03:46:01.660952 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:46:01.660919 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6251836-5d27-4a09-ac82-5e4081700d84" path="/var/lib/kubelet/pods/b6251836-5d27-4a09-ac82-5e4081700d84/volumes" Jul 09 03:47:32.806194 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806164 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt"] Jul 09 03:47:32.806661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806520 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6251836-5d27-4a09-ac82-5e4081700d84" containerName="console" Jul 09 03:47:32.806661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806533 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6251836-5d27-4a09-ac82-5e4081700d84" containerName="console" Jul 09 03:47:32.806661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806549 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" containerName="console" Jul 09 03:47:32.806661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806555 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" containerName="console" Jul 09 03:47:32.806661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806612 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6251836-5d27-4a09-ac82-5e4081700d84" containerName="console" Jul 09 03:47:32.806661 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.806622 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4a1d6b-c5e4-4f97-8d67-9acbebc2ad00" containerName="console" Jul 09 03:47:32.808345 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.808326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.811755 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.811730 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 03:47:32.811883 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.811761 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 03:47:32.811883 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.811782 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 03:47:32.811883 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.811801 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 03:47:32.811883 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.811876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-688t6\"" Jul 09 03:47:32.812094 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.811879 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 03:47:32.819521 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.819503 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt"] Jul 09 03:47:32.882083 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.882058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beba24eb-2e74-4157-b750-af2a746c1728-cert\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.882178 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.882103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/beba24eb-2e74-4157-b750-af2a746c1728-metrics-cert\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.882221 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.882195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/beba24eb-2e74-4157-b750-af2a746c1728-manager-config\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.882256 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.882234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsfs9\" (UniqueName: \"kubernetes.io/projected/beba24eb-2e74-4157-b750-af2a746c1728-kube-api-access-jsfs9\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.982962 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.982936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/beba24eb-2e74-4157-b750-af2a746c1728-manager-config\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.983083 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.982986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfs9\" (UniqueName: \"kubernetes.io/projected/beba24eb-2e74-4157-b750-af2a746c1728-kube-api-access-jsfs9\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.983083 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.983021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beba24eb-2e74-4157-b750-af2a746c1728-cert\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.983083 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.983048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/beba24eb-2e74-4157-b750-af2a746c1728-metrics-cert\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.983754 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.983731 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/beba24eb-2e74-4157-b750-af2a746c1728-manager-config\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.985608 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.985582 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/beba24eb-2e74-4157-b750-af2a746c1728-metrics-cert\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.985699 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.985609 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beba24eb-2e74-4157-b750-af2a746c1728-cert\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:32.996423 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:32.996401 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfs9\" (UniqueName: \"kubernetes.io/projected/beba24eb-2e74-4157-b750-af2a746c1728-kube-api-access-jsfs9\") pod \"lws-controller-manager-7f5f9c4b6d-r9cbt\" (UID: \"beba24eb-2e74-4157-b750-af2a746c1728\") " pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:33.118186 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:33.118133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:33.239212 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:33.239190 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt"] Jul 09 03:47:33.241682 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:47:33.241649 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeba24eb_2e74_4157_b750_af2a746c1728.slice/crio-10838b5f54bf9c9825702e450e6b24736d9e1297a2bcc641c670a0f6bfda7db0 WatchSource:0}: Error finding container 10838b5f54bf9c9825702e450e6b24736d9e1297a2bcc641c670a0f6bfda7db0: Status 404 returned error can't find the container with id 10838b5f54bf9c9825702e450e6b24736d9e1297a2bcc641c670a0f6bfda7db0 Jul 09 03:47:34.053853 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:34.053816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" event={"ID":"beba24eb-2e74-4157-b750-af2a746c1728","Type":"ContainerStarted","Data":"10838b5f54bf9c9825702e450e6b24736d9e1297a2bcc641c670a0f6bfda7db0"} Jul 09 03:47:37.070687 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.070654 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" event={"ID":"beba24eb-2e74-4157-b750-af2a746c1728","Type":"ContainerStarted","Data":"2c3a5b5f281aeac7c8567cd8736cc882aca12325219220f21ea659bbd08809a2"} Jul 09 03:47:37.070687 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.070703 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm"] Jul 09 03:47:37.073052 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.073036 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:37.073115 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.073105 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.076126 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.076104 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 03:47:37.076244 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.076155 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 03:47:37.076335 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.076320 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 03:47:37.076455 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.076440 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 03:47:37.076946 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.076932 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gpbc5\"" Jul 09 03:47:37.090944 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.090915 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm"] Jul 09 03:47:37.116746 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.116713 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4c31377-bac2-42ac-84a0-453a854a02d3-tmp\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.116889 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.116780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4c31377-bac2-42ac-84a0-453a854a02d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.116940 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.116907 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4c31377-bac2-42ac-84a0-453a854a02d3-manifests\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.116988 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.116951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4c31377-bac2-42ac-84a0-453a854a02d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.117054 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.117022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pglmm\" (UniqueName: \"kubernetes.io/projected/b4c31377-bac2-42ac-84a0-453a854a02d3-kube-api-access-pglmm\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.125188 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.125143 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" podStartSLOduration=2.119015539 podStartE2EDuration="5.125128556s" totalImagesPullingTime="3.006113017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:47:37.103567452 +0000 UTC m=+297.968177709" watchObservedRunningTime="2026-07-09 03:47:37.125128556 +0000 UTC m=+297.989738812" Jul 09 03:47:37.217995 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.217968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4c31377-bac2-42ac-84a0-453a854a02d3-tmp\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.218146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.218022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4c31377-bac2-42ac-84a0-453a854a02d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.218146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.218058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4c31377-bac2-42ac-84a0-453a854a02d3-manifests\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.218146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.218102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4c31377-bac2-42ac-84a0-453a854a02d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.218302 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.218144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pglmm\" (UniqueName: \"kubernetes.io/projected/b4c31377-bac2-42ac-84a0-453a854a02d3-kube-api-access-pglmm\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.218487 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.218456 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4c31377-bac2-42ac-84a0-453a854a02d3-manifests\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.220297 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.220267 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4c31377-bac2-42ac-84a0-453a854a02d3-tmp\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.220549 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.220531 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4c31377-bac2-42ac-84a0-453a854a02d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.220609 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.220534 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4c31377-bac2-42ac-84a0-453a854a02d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.226167 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.226147 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pglmm\" (UniqueName: \"kubernetes.io/projected/b4c31377-bac2-42ac-84a0-453a854a02d3-kube-api-access-pglmm\") pod \"opendatahub-operator-controller-manager-645c4d5897-cjhkm\" (UID: \"b4c31377-bac2-42ac-84a0-453a854a02d3\") " pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.383112 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.383057 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:37.513914 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:37.513866 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm"] Jul 09 03:47:37.515981 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:47:37.515953 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c31377_bac2_42ac_84a0_453a854a02d3.slice/crio-7a75f4b9e947c75ee5a94aa3a6b86293550251e183bead6e819e0d6c46a4a5ce WatchSource:0}: Error finding container 7a75f4b9e947c75ee5a94aa3a6b86293550251e183bead6e819e0d6c46a4a5ce: Status 404 returned error can't find the container with id 7a75f4b9e947c75ee5a94aa3a6b86293550251e183bead6e819e0d6c46a4a5ce Jul 09 03:47:38.076322 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:38.076287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" event={"ID":"b4c31377-bac2-42ac-84a0-453a854a02d3","Type":"ContainerStarted","Data":"7a75f4b9e947c75ee5a94aa3a6b86293550251e183bead6e819e0d6c46a4a5ce"} Jul 09 03:47:40.580001 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:40.579973 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 03:47:41.091874 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:41.091841 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" event={"ID":"b4c31377-bac2-42ac-84a0-453a854a02d3","Type":"ContainerStarted","Data":"88ef529e7e8236f397c92580c6fcd9ccb13576c710c2c26d4949850c43baab77"} Jul 09 03:47:42.097929 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:42.097855 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4c31377-bac2-42ac-84a0-453a854a02d3" containerID="88ef529e7e8236f397c92580c6fcd9ccb13576c710c2c26d4949850c43baab77" exitCode=0 Jul 09 03:47:42.097929 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:42.097905 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" event={"ID":"b4c31377-bac2-42ac-84a0-453a854a02d3","Type":"ContainerDied","Data":"88ef529e7e8236f397c92580c6fcd9ccb13576c710c2c26d4949850c43baab77"} Jul 09 03:47:42.098415 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:42.098399 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 03:47:43.104217 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:43.104183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" event={"ID":"b4c31377-bac2-42ac-84a0-453a854a02d3","Type":"ContainerStarted","Data":"e398cde2488b0904508b86da20d1a8ad4b39953c05feb3fa5b832ae098016fdc"} Jul 09 03:47:43.104621 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:43.104288 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:47:43.127403 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:43.127340 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" podStartSLOduration=1.618006008 podStartE2EDuration="6.127324923s" totalImagesPullingTime="3.471865561s" totalInitContainerRuntime="1.037453354s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:47:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:47:43.12561707 +0000 UTC m=+303.990227343" watchObservedRunningTime="2026-07-09 03:47:43.127324923 +0000 UTC m=+303.991935179" Jul 09 03:47:49.084789 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:49.084759 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f5f9c4b6d-r9cbt" Jul 09 03:47:54.110921 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:47:54.110889 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-645c4d5897-cjhkm" Jul 09 03:48:01.654109 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.654077 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz"] Jul 09 03:48:01.665002 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.664965 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.667699 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.667665 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 03:48:01.668063 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.668043 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 03:48:01.668177 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.668110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 03:48:01.668783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.668763 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 03:48:01.668909 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.668831 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-992kn\"" Jul 09 03:48:01.672102 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.672079 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz"] Jul 09 03:48:01.818781 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.818754 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79fc74d7-1119-40a7-8909-c848f52757c4-tls-certs\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.818939 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.818804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79fc74d7-1119-40a7-8909-c848f52757c4-tmp\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.819005 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.818934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlrq7\" (UniqueName: \"kubernetes.io/projected/79fc74d7-1119-40a7-8909-c848f52757c4-kube-api-access-tlrq7\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.920347 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.920268 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlrq7\" (UniqueName: \"kubernetes.io/projected/79fc74d7-1119-40a7-8909-c848f52757c4-kube-api-access-tlrq7\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.920347 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.920323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79fc74d7-1119-40a7-8909-c848f52757c4-tls-certs\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.920546 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.920403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79fc74d7-1119-40a7-8909-c848f52757c4-tmp\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.922593 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.922564 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79fc74d7-1119-40a7-8909-c848f52757c4-tmp\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.922749 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.922730 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79fc74d7-1119-40a7-8909-c848f52757c4-tls-certs\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.927956 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.927934 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlrq7\" (UniqueName: \"kubernetes.io/projected/79fc74d7-1119-40a7-8909-c848f52757c4-kube-api-access-tlrq7\") pod \"kube-auth-proxy-5796d489b5-dq7tz\" (UID: \"79fc74d7-1119-40a7-8909-c848f52757c4\") " pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:01.976783 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:01.976761 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" Jul 09 03:48:02.116319 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:02.116293 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz"] Jul 09 03:48:02.117596 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:48:02.117565 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fc74d7_1119_40a7_8909_c848f52757c4.slice/crio-4c3174dd174bf52c99b64e88bf6e5467b83f817c29fdcf13638059832194b29e WatchSource:0}: Error finding container 4c3174dd174bf52c99b64e88bf6e5467b83f817c29fdcf13638059832194b29e: Status 404 returned error can't find the container with id 4c3174dd174bf52c99b64e88bf6e5467b83f817c29fdcf13638059832194b29e Jul 09 03:48:02.184443 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:02.184386 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" event={"ID":"79fc74d7-1119-40a7-8909-c848f52757c4","Type":"ContainerStarted","Data":"4c3174dd174bf52c99b64e88bf6e5467b83f817c29fdcf13638059832194b29e"} Jul 09 03:48:05.201219 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:05.201187 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" event={"ID":"79fc74d7-1119-40a7-8909-c848f52757c4","Type":"ContainerStarted","Data":"6b16c0945ce13037672156678e8af77ed0b4c9f012ff0041e8ab95fce729164b"} Jul 09 03:48:05.220118 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:05.220067 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5796d489b5-dq7tz" podStartSLOduration=1.649106967 podStartE2EDuration="4.220052623s" totalImagesPullingTime="2.570945656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:48:05.218553338 +0000 UTC m=+326.083163597" watchObservedRunningTime="2026-07-09 03:48:05.220052623 +0000 UTC m=+326.084662904" Jul 09 03:48:11.542591 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.542549 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4"] Jul 09 03:48:11.551862 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.551833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:11.555513 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.555489 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 03:48:11.555868 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.555498 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7t8wg\"" Jul 09 03:48:11.558611 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.558591 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4"] Jul 09 03:48:11.703212 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.703181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxpr\" (UniqueName: \"kubernetes.io/projected/cc7d0f87-d59b-4493-a138-db4676cabc0a-kube-api-access-vjxpr\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:11.703408 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.703218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7d0f87-d59b-4493-a138-db4676cabc0a-cert\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:11.804554 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.804461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxpr\" (UniqueName: \"kubernetes.io/projected/cc7d0f87-d59b-4493-a138-db4676cabc0a-kube-api-access-vjxpr\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:11.804554 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.804515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7d0f87-d59b-4493-a138-db4676cabc0a-cert\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:11.804725 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:48:11.804621 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 03:48:11.804725 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:48:11.804706 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc7d0f87-d59b-4493-a138-db4676cabc0a-cert podName:cc7d0f87-d59b-4493-a138-db4676cabc0a nodeName:}" failed. No retries permitted until 2026-07-09 03:48:12.304685896 +0000 UTC m=+333.169296147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cc7d0f87-d59b-4493-a138-db4676cabc0a-cert") pod "kserve-controller-manager-d6f4b65b8-rq8z4" (UID: "cc7d0f87-d59b-4493-a138-db4676cabc0a") : secret "kserve-webhook-server-cert" not found Jul 09 03:48:11.819387 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:11.819331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxpr\" (UniqueName: \"kubernetes.io/projected/cc7d0f87-d59b-4493-a138-db4676cabc0a-kube-api-access-vjxpr\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:12.308477 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:12.308445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7d0f87-d59b-4493-a138-db4676cabc0a-cert\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:12.310860 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:12.310836 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7d0f87-d59b-4493-a138-db4676cabc0a-cert\") pod \"kserve-controller-manager-d6f4b65b8-rq8z4\" (UID: \"cc7d0f87-d59b-4493-a138-db4676cabc0a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:12.463228 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:12.463197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:12.795242 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:12.795220 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4"] Jul 09 03:48:12.797872 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:48:12.797844 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7d0f87_d59b_4493_a138_db4676cabc0a.slice/crio-d0ae7a41158c109de0a9dc6e269711617fc613b91cff97427c89a21957059808 WatchSource:0}: Error finding container d0ae7a41158c109de0a9dc6e269711617fc613b91cff97427c89a21957059808: Status 404 returned error can't find the container with id d0ae7a41158c109de0a9dc6e269711617fc613b91cff97427c89a21957059808 Jul 09 03:48:13.238226 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:13.238191 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" event={"ID":"cc7d0f87-d59b-4493-a138-db4676cabc0a","Type":"ContainerStarted","Data":"d0ae7a41158c109de0a9dc6e269711617fc613b91cff97427c89a21957059808"} Jul 09 03:48:15.249104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:15.249070 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" event={"ID":"cc7d0f87-d59b-4493-a138-db4676cabc0a","Type":"ContainerStarted","Data":"37d47cc33b76a638c769de94c1db2b5f4de34d73cb3c89dcaff60994bd784e8c"} Jul 09 03:48:15.249536 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:15.249228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:48:15.266069 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:15.266021 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" podStartSLOduration=1.957758401 podStartE2EDuration="4.266007607s" totalImagesPullingTime="2.308249206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:48:15.263575187 +0000 UTC m=+336.128185445" watchObservedRunningTime="2026-07-09 03:48:15.266007607 +0000 UTC m=+336.130617863" Jul 09 03:48:46.258791 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:48:46.258721 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rq8z4" Jul 09 03:49:48.194381 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.192753 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc"] Jul 09 03:49:48.198026 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.198000 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.200379 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.200345 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 03:49:48.200502 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.200472 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gkqxk\"" Jul 09 03:49:48.200570 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.200553 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 03:49:48.201349 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.201332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 03:49:48.201349 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.201346 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 03:49:48.203893 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.203874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc"] Jul 09 03:49:48.281129 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.281106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3171d9d-9569-49e3-9361-ab1d901c428d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.281313 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.281299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk9md\" (UniqueName: \"kubernetes.io/projected/d3171d9d-9569-49e3-9361-ab1d901c428d-kube-api-access-xk9md\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.281389 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.281352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d3171d9d-9569-49e3-9361-ab1d901c428d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.382414 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.382391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d3171d9d-9569-49e3-9361-ab1d901c428d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.382521 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.382429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3171d9d-9569-49e3-9361-ab1d901c428d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.382521 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.382480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk9md\" (UniqueName: \"kubernetes.io/projected/d3171d9d-9569-49e3-9361-ab1d901c428d-kube-api-access-xk9md\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.382618 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:48.382599 2556 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 03:49:48.382678 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:48.382667 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3171d9d-9569-49e3-9361-ab1d901c428d-plugin-serving-cert podName:d3171d9d-9569-49e3-9361-ab1d901c428d nodeName:}" failed. No retries permitted until 2026-07-09 03:49:48.882648389 +0000 UTC m=+429.747258624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d3171d9d-9569-49e3-9361-ab1d901c428d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6tkpc" (UID: "d3171d9d-9569-49e3-9361-ab1d901c428d") : secret "plugin-serving-cert" not found Jul 09 03:49:48.383000 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.382983 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d3171d9d-9569-49e3-9361-ab1d901c428d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.394481 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.394456 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk9md\" (UniqueName: \"kubernetes.io/projected/d3171d9d-9569-49e3-9361-ab1d901c428d-kube-api-access-xk9md\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.886681 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.886637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3171d9d-9569-49e3-9361-ab1d901c428d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:48.889295 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:48.889265 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3171d9d-9569-49e3-9361-ab1d901c428d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6tkpc\" (UID: \"d3171d9d-9569-49e3-9361-ab1d901c428d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:49.116636 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:49.116609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" Jul 09 03:49:49.240452 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:49.240430 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc"] Jul 09 03:49:49.242336 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:49:49.242306 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3171d9d_9569_49e3_9361_ab1d901c428d.slice/crio-a6ee51514f8721bd725c7c743782b6c2ace076b79d0ca645aba43a10abafc608 WatchSource:0}: Error finding container a6ee51514f8721bd725c7c743782b6c2ace076b79d0ca645aba43a10abafc608: Status 404 returned error can't find the container with id a6ee51514f8721bd725c7c743782b6c2ace076b79d0ca645aba43a10abafc608 Jul 09 03:49:49.666088 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:49.666057 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" event={"ID":"d3171d9d-9569-49e3-9361-ab1d901c428d","Type":"ContainerStarted","Data":"a6ee51514f8721bd725c7c743782b6c2ace076b79d0ca645aba43a10abafc608"} Jul 09 03:49:58.762072 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.762041 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf"] Jul 09 03:49:58.768662 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.768633 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:58.773181 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.773151 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fhkmc\"" Jul 09 03:49:58.781065 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.781038 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf"] Jul 09 03:49:58.807971 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.807946 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf"] Jul 09 03:49:58.808267 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:58.808243 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-9r5s6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" podUID="11e42a17-443a-41c5-b7b3-b596d4d33901" Jul 09 03:49:58.825586 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.825524 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf"] Jul 09 03:49:58.881981 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.881929 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5s6\" (UniqueName: \"kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6\") pod \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:58.882145 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.882014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11e42a17-443a-41c5-b7b3-b596d4d33901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:58.983203 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.983171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5s6\" (UniqueName: \"kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6\") pod \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:58.983403 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.983233 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11e42a17-443a-41c5-b7b3-b596d4d33901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:58.983651 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:58.983623 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11e42a17-443a-41c5-b7b3-b596d4d33901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:58.986203 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:58.986176 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9r5s6 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-153.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object Jul 09 03:49:58.986312 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:58.986252 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6 podName:11e42a17-443a-41c5-b7b3-b596d4d33901 nodeName:}" failed. No retries permitted until 2026-07-09 03:49:59.48623535 +0000 UTC m=+440.350845585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9r5s6" (UniqueName: "kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6") pod "kuadrant-operator-controller-manager-86878c769f-x8lrf" (UID: "11e42a17-443a-41c5-b7b3-b596d4d33901") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-153.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object Jul 09 03:49:59.489253 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.489217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5s6\" (UniqueName: \"kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6\") pod \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:59.491640 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:59.491614 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9r5s6 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-153.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object Jul 09 03:49:59.491771 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:59.491694 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6 podName:11e42a17-443a-41c5-b7b3-b596d4d33901 nodeName:}" failed. No retries permitted until 2026-07-09 03:50:00.491671773 +0000 UTC m=+441.356282010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9r5s6" (UniqueName: "kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6") pod "kuadrant-operator-controller-manager-86878c769f-x8lrf" (UID: "11e42a17-443a-41c5-b7b3-b596d4d33901") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-153.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object Jul 09 03:49:59.717060 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.717027 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:59.731686 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.731663 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:59.734025 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:49:59.733982 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="11e42a17-443a-41c5-b7b3-b596d4d33901" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:49:59.893001 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.892916 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11e42a17-443a-41c5-b7b3-b596d4d33901-extensions-socket-volume\") pod \"11e42a17-443a-41c5-b7b3-b596d4d33901\" (UID: \"11e42a17-443a-41c5-b7b3-b596d4d33901\") " Jul 09 03:49:59.893435 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.893186 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e42a17-443a-41c5-b7b3-b596d4d33901-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "11e42a17-443a-41c5-b7b3-b596d4d33901" (UID: "11e42a17-443a-41c5-b7b3-b596d4d33901"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:49:59.893435 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.893274 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11e42a17-443a-41c5-b7b3-b596d4d33901-extensions-socket-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:49:59.893435 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:49:59.893295 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r5s6\" (UniqueName: \"kubernetes.io/projected/11e42a17-443a-41c5-b7b3-b596d4d33901-kube-api-access-9r5s6\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:50:00.722256 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:00.722227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:50:00.729768 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:50:00.729729 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="11e42a17-443a-41c5-b7b3-b596d4d33901" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:50:00.732164 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:50:00.732126 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-x8lrf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="11e42a17-443a-41c5-b7b3-b596d4d33901" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x8lrf" Jul 09 03:50:01.662788 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:01.662753 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11e42a17-443a-41c5-b7b3-b596d4d33901" path="/var/lib/kubelet/pods/11e42a17-443a-41c5-b7b3-b596d4d33901/volumes" Jul 09 03:50:12.783672 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:12.783644 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" event={"ID":"d3171d9d-9569-49e3-9361-ab1d901c428d","Type":"ContainerStarted","Data":"105fa9599eb5652fbefc426d86c44f77756d17409eff7e7a0e9883236a63dde6"} Jul 09 03:50:12.798747 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:12.798699 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6tkpc" podStartSLOduration=1.384234199 podStartE2EDuration="24.798685037s" totalImagesPullingTime="23.414450838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:50:12.797109833 +0000 UTC m=+453.661720102" watchObservedRunningTime="2026-07-09 03:50:12.798685037 +0000 UTC m=+453.663295315" Jul 09 03:50:34.483734 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.483701 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:50:34.486080 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.486060 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.488571 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.488553 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 03:50:34.496630 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.496609 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:50:34.526875 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.526853 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:50:34.581907 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.581880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4p9\" (UniqueName: \"kubernetes.io/projected/fead40b5-21cb-49b2-8662-ed37958a2939-kube-api-access-jx4p9\") pod \"limitador-limitador-54d6d988d5-brvj9\" (UID: \"fead40b5-21cb-49b2-8662-ed37958a2939\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.582047 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.581966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fead40b5-21cb-49b2-8662-ed37958a2939-config-file\") pod \"limitador-limitador-54d6d988d5-brvj9\" (UID: \"fead40b5-21cb-49b2-8662-ed37958a2939\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.682477 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.682453 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fead40b5-21cb-49b2-8662-ed37958a2939-config-file\") pod \"limitador-limitador-54d6d988d5-brvj9\" (UID: \"fead40b5-21cb-49b2-8662-ed37958a2939\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.682580 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.682509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4p9\" (UniqueName: \"kubernetes.io/projected/fead40b5-21cb-49b2-8662-ed37958a2939-kube-api-access-jx4p9\") pod \"limitador-limitador-54d6d988d5-brvj9\" (UID: \"fead40b5-21cb-49b2-8662-ed37958a2939\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.683009 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.682992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fead40b5-21cb-49b2-8662-ed37958a2939-config-file\") pod \"limitador-limitador-54d6d988d5-brvj9\" (UID: \"fead40b5-21cb-49b2-8662-ed37958a2939\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.693718 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.693693 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4p9\" (UniqueName: \"kubernetes.io/projected/fead40b5-21cb-49b2-8662-ed37958a2939-kube-api-access-jx4p9\") pod \"limitador-limitador-54d6d988d5-brvj9\" (UID: \"fead40b5-21cb-49b2-8662-ed37958a2939\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.796881 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.796826 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:34.921924 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:34.921900 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:50:34.923901 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:50:34.923870 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfead40b5_21cb_49b2_8662_ed37958a2939.slice/crio-75913dfb13c03eddb327e790d21307f9abfb16f90bc8a3c0c7b205348432c547 WatchSource:0}: Error finding container 75913dfb13c03eddb327e790d21307f9abfb16f90bc8a3c0c7b205348432c547: Status 404 returned error can't find the container with id 75913dfb13c03eddb327e790d21307f9abfb16f90bc8a3c0c7b205348432c547 Jul 09 03:50:35.214526 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.214497 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7kzq8"] Jul 09 03:50:35.217580 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.217558 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:50:35.219914 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.219896 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q95d2\"" Jul 09 03:50:35.223125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.223106 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7kzq8"] Jul 09 03:50:35.287623 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.287602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s6bz\" (UniqueName: \"kubernetes.io/projected/184b4f77-4685-42fa-84a8-29e86498100b-kube-api-access-9s6bz\") pod \"authorino-75d556bd77-7kzq8\" (UID: \"184b4f77-4685-42fa-84a8-29e86498100b\") " pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:50:35.388509 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.388482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s6bz\" (UniqueName: \"kubernetes.io/projected/184b4f77-4685-42fa-84a8-29e86498100b-kube-api-access-9s6bz\") pod \"authorino-75d556bd77-7kzq8\" (UID: \"184b4f77-4685-42fa-84a8-29e86498100b\") " pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:50:35.396692 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.396668 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s6bz\" (UniqueName: \"kubernetes.io/projected/184b4f77-4685-42fa-84a8-29e86498100b-kube-api-access-9s6bz\") pod \"authorino-75d556bd77-7kzq8\" (UID: \"184b4f77-4685-42fa-84a8-29e86498100b\") " pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:50:35.527503 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.527281 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:50:35.708698 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.707795 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7kzq8"] Jul 09 03:50:35.714530 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:50:35.714500 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod184b4f77_4685_42fa_84a8_29e86498100b.slice/crio-0263e2c3cf7dafd10a551245cb4ec0339793a616e840374456bb53453470b697 WatchSource:0}: Error finding container 0263e2c3cf7dafd10a551245cb4ec0339793a616e840374456bb53453470b697: Status 404 returned error can't find the container with id 0263e2c3cf7dafd10a551245cb4ec0339793a616e840374456bb53453470b697 Jul 09 03:50:35.890083 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.890003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" event={"ID":"fead40b5-21cb-49b2-8662-ed37958a2939","Type":"ContainerStarted","Data":"75913dfb13c03eddb327e790d21307f9abfb16f90bc8a3c0c7b205348432c547"} Jul 09 03:50:35.891406 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:35.891350 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7kzq8" event={"ID":"184b4f77-4685-42fa-84a8-29e86498100b","Type":"ContainerStarted","Data":"0263e2c3cf7dafd10a551245cb4ec0339793a616e840374456bb53453470b697"} Jul 09 03:50:37.907807 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:37.907766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" event={"ID":"fead40b5-21cb-49b2-8662-ed37958a2939","Type":"ContainerStarted","Data":"b41f48d21d08da7fa3334c541beeda3b113bbc26056a2f0700df244d1b501bb1"} Jul 09 03:50:37.908215 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:37.907919 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:50:37.925567 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:37.925521 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" podStartSLOduration=1.361423522 podStartE2EDuration="3.925508917s" totalImagesPullingTime="2.564085395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:50:37.924142054 +0000 UTC m=+478.788752321" watchObservedRunningTime="2026-07-09 03:50:37.925508917 +0000 UTC m=+478.790119172" Jul 09 03:50:39.919448 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:39.919372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7kzq8" event={"ID":"184b4f77-4685-42fa-84a8-29e86498100b","Type":"ContainerStarted","Data":"89299d5b8288f95a40b8ddea34ebbb855787ee2e690a03790f51961803378597"} Jul 09 03:50:39.935042 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:39.934991 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7kzq8" podStartSLOduration=1.093270282 podStartE2EDuration="4.934976187s" totalImagesPullingTime="3.841705905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:50:39.933462189 +0000 UTC m=+480.798072446" watchObservedRunningTime="2026-07-09 03:50:39.934976187 +0000 UTC m=+480.799586443" Jul 09 03:50:48.914732 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:50:48.914699 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-brvj9" Jul 09 03:51:03.255821 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.255784 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78748444f9-gd7hm"] Jul 09 03:51:03.259289 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.259267 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:03.266958 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.266390 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78748444f9-gd7hm"] Jul 09 03:51:03.328341 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.328315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwk28\" (UniqueName: \"kubernetes.io/projected/916af136-5356-49ad-a0cc-fb2fc492b5b5-kube-api-access-cwk28\") pod \"authorino-78748444f9-gd7hm\" (UID: \"916af136-5356-49ad-a0cc-fb2fc492b5b5\") " pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:03.429306 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.429275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwk28\" (UniqueName: \"kubernetes.io/projected/916af136-5356-49ad-a0cc-fb2fc492b5b5-kube-api-access-cwk28\") pod \"authorino-78748444f9-gd7hm\" (UID: \"916af136-5356-49ad-a0cc-fb2fc492b5b5\") " pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:03.435683 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.435662 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78748444f9-gd7hm"] Jul 09 03:51:03.435897 ip-10-0-143-153 kubenswrapper[2556]: E0709 03:51:03.435879 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cwk28], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-78748444f9-gd7hm" podUID="916af136-5356-49ad-a0cc-fb2fc492b5b5" Jul 09 03:51:03.438796 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:03.438775 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwk28\" (UniqueName: \"kubernetes.io/projected/916af136-5356-49ad-a0cc-fb2fc492b5b5-kube-api-access-cwk28\") pod \"authorino-78748444f9-gd7hm\" (UID: \"916af136-5356-49ad-a0cc-fb2fc492b5b5\") " pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:04.023482 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.023450 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:04.030128 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.030109 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:04.032674 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.032657 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwk28\" (UniqueName: \"kubernetes.io/projected/916af136-5356-49ad-a0cc-fb2fc492b5b5-kube-api-access-cwk28\") pod \"916af136-5356-49ad-a0cc-fb2fc492b5b5\" (UID: \"916af136-5356-49ad-a0cc-fb2fc492b5b5\") " Jul 09 03:51:04.034624 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.034603 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916af136-5356-49ad-a0cc-fb2fc492b5b5-kube-api-access-cwk28" (OuterVolumeSpecName: "kube-api-access-cwk28") pod "916af136-5356-49ad-a0cc-fb2fc492b5b5" (UID: "916af136-5356-49ad-a0cc-fb2fc492b5b5"). InnerVolumeSpecName "kube-api-access-cwk28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:51:04.133251 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.133219 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwk28\" (UniqueName: \"kubernetes.io/projected/916af136-5356-49ad-a0cc-fb2fc492b5b5-kube-api-access-cwk28\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:51:04.833403 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.833352 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7kzq8"] Jul 09 03:51:04.833781 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:04.833552 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7kzq8" podUID="184b4f77-4685-42fa-84a8-29e86498100b" containerName="authorino" containerID="cri-o://89299d5b8288f95a40b8ddea34ebbb855787ee2e690a03790f51961803378597" gracePeriod=30 Jul 09 03:51:05.029932 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.029900 2556 generic.go:356] "Generic (PLEG): container finished" podID="184b4f77-4685-42fa-84a8-29e86498100b" containerID="89299d5b8288f95a40b8ddea34ebbb855787ee2e690a03790f51961803378597" exitCode=0 Jul 09 03:51:05.030068 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.029975 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78748444f9-gd7hm" Jul 09 03:51:05.030068 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.029977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7kzq8" event={"ID":"184b4f77-4685-42fa-84a8-29e86498100b","Type":"ContainerDied","Data":"89299d5b8288f95a40b8ddea34ebbb855787ee2e690a03790f51961803378597"} Jul 09 03:51:05.057193 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.057161 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78748444f9-gd7hm"] Jul 09 03:51:05.062012 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.061977 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78748444f9-gd7hm"] Jul 09 03:51:05.082944 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.082924 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:51:05.140225 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.140161 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s6bz\" (UniqueName: \"kubernetes.io/projected/184b4f77-4685-42fa-84a8-29e86498100b-kube-api-access-9s6bz\") pod \"184b4f77-4685-42fa-84a8-29e86498100b\" (UID: \"184b4f77-4685-42fa-84a8-29e86498100b\") " Jul 09 03:51:05.142244 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.142215 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184b4f77-4685-42fa-84a8-29e86498100b-kube-api-access-9s6bz" (OuterVolumeSpecName: "kube-api-access-9s6bz") pod "184b4f77-4685-42fa-84a8-29e86498100b" (UID: "184b4f77-4685-42fa-84a8-29e86498100b"). InnerVolumeSpecName "kube-api-access-9s6bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:51:05.241634 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.241610 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s6bz\" (UniqueName: \"kubernetes.io/projected/184b4f77-4685-42fa-84a8-29e86498100b-kube-api-access-9s6bz\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 03:51:05.663895 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:05.663842 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="916af136-5356-49ad-a0cc-fb2fc492b5b5" path="/var/lib/kubelet/pods/916af136-5356-49ad-a0cc-fb2fc492b5b5/volumes" Jul 09 03:51:06.035076 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:06.035006 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7kzq8" Jul 09 03:51:06.035076 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:06.035010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7kzq8" event={"ID":"184b4f77-4685-42fa-84a8-29e86498100b","Type":"ContainerDied","Data":"0263e2c3cf7dafd10a551245cb4ec0339793a616e840374456bb53453470b697"} Jul 09 03:51:06.035076 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:06.035065 2556 scope.go:117] "RemoveContainer" containerID="89299d5b8288f95a40b8ddea34ebbb855787ee2e690a03790f51961803378597" Jul 09 03:51:06.052815 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:06.052792 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7kzq8"] Jul 09 03:51:06.060699 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:06.060671 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7kzq8"] Jul 09 03:51:07.662204 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:07.662167 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184b4f77-4685-42fa-84a8-29e86498100b" path="/var/lib/kubelet/pods/184b4f77-4685-42fa-84a8-29e86498100b/volumes" Jul 09 03:51:45.842308 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.842253 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-86h7c"] Jul 09 03:51:45.842838 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.842820 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184b4f77-4685-42fa-84a8-29e86498100b" containerName="authorino" Jul 09 03:51:45.842921 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.842842 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="184b4f77-4685-42fa-84a8-29e86498100b" containerName="authorino" Jul 09 03:51:45.842986 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.842970 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="184b4f77-4685-42fa-84a8-29e86498100b" containerName="authorino" Jul 09 03:51:45.845631 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.845607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:45.848605 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.848583 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5hktm\"" Jul 09 03:51:45.848706 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.848593 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 03:51:45.849588 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.849566 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:51:45.852639 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.852615 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-86h7c"] Jul 09 03:51:45.901277 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.901242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed58fd18-cec4-48ca-8fa1-724ff7abeee1-plugins-config-volume\") pod \"payload-pre-processing-7964457696-86h7c\" (UID: \"ed58fd18-cec4-48ca-8fa1-724ff7abeee1\") " pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:45.901277 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:45.901280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pql8c\" (UniqueName: \"kubernetes.io/projected/ed58fd18-cec4-48ca-8fa1-724ff7abeee1-kube-api-access-pql8c\") pod \"payload-pre-processing-7964457696-86h7c\" (UID: \"ed58fd18-cec4-48ca-8fa1-724ff7abeee1\") " pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:46.002401 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:46.002340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed58fd18-cec4-48ca-8fa1-724ff7abeee1-plugins-config-volume\") pod \"payload-pre-processing-7964457696-86h7c\" (UID: \"ed58fd18-cec4-48ca-8fa1-724ff7abeee1\") " pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:46.002401 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:46.002400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pql8c\" (UniqueName: \"kubernetes.io/projected/ed58fd18-cec4-48ca-8fa1-724ff7abeee1-kube-api-access-pql8c\") pod \"payload-pre-processing-7964457696-86h7c\" (UID: \"ed58fd18-cec4-48ca-8fa1-724ff7abeee1\") " pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:46.003018 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:46.002997 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed58fd18-cec4-48ca-8fa1-724ff7abeee1-plugins-config-volume\") pod \"payload-pre-processing-7964457696-86h7c\" (UID: \"ed58fd18-cec4-48ca-8fa1-724ff7abeee1\") " pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:46.009559 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:46.009537 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pql8c\" (UniqueName: \"kubernetes.io/projected/ed58fd18-cec4-48ca-8fa1-724ff7abeee1-kube-api-access-pql8c\") pod \"payload-pre-processing-7964457696-86h7c\" (UID: \"ed58fd18-cec4-48ca-8fa1-724ff7abeee1\") " pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:46.157056 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:46.157025 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:46.282085 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:46.282062 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-86h7c"] Jul 09 03:51:46.284619 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:51:46.284591 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded58fd18_cec4_48ca_8fa1_724ff7abeee1.slice/crio-4514bd301b5ea301ab88f98163ef5d5d0d39e648bab24cafa4cfa17e2bd4dca0 WatchSource:0}: Error finding container 4514bd301b5ea301ab88f98163ef5d5d0d39e648bab24cafa4cfa17e2bd4dca0: Status 404 returned error can't find the container with id 4514bd301b5ea301ab88f98163ef5d5d0d39e648bab24cafa4cfa17e2bd4dca0 Jul 09 03:51:47.221411 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:47.221378 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" event={"ID":"ed58fd18-cec4-48ca-8fa1-724ff7abeee1","Type":"ContainerStarted","Data":"4514bd301b5ea301ab88f98163ef5d5d0d39e648bab24cafa4cfa17e2bd4dca0"} Jul 09 03:51:48.227302 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:48.227265 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" event={"ID":"ed58fd18-cec4-48ca-8fa1-724ff7abeee1","Type":"ContainerStarted","Data":"f3ed328f37587c5f06e3b63c8dca869c9d34fb45030d2062953d043dfc6a9102"} Jul 09 03:51:48.227711 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:48.227374 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:51:48.245365 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:48.245306 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" podStartSLOduration=1.8961973909999998 podStartE2EDuration="3.245287384s" totalImagesPullingTime="1.349089993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:51:48.242992803 +0000 UTC m=+549.107603061" watchObservedRunningTime="2026-07-09 03:51:48.245287384 +0000 UTC m=+549.109897642" Jul 09 03:51:59.234428 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:51:59.234396 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-86h7c" Jul 09 03:52:06.426336 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:06.426301 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:52:20.333640 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:20.333605 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:52:35.328669 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:35.328639 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:52:46.838311 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:46.838274 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:52:55.722581 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.722548 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987"] Jul 09 03:52:55.725937 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.725916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.728271 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.728252 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 03:52:55.728377 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.728282 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-27f2j\"" Jul 09 03:52:55.729367 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.729343 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 03:52:55.729431 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.729412 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 03:52:55.735455 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.735421 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987"] Jul 09 03:52:55.808919 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.808890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.809043 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.808925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5qm\" (UniqueName: \"kubernetes.io/projected/6f622fc4-b48e-4599-a6de-b778fc685a3d-kube-api-access-qp5qm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.809105 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.809036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622fc4-b48e-4599-a6de-b778fc685a3d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.809172 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.809151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.809262 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.809244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.809399 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.809302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.909937 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.909904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.909937 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.909941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5qm\" (UniqueName: \"kubernetes.io/projected/6f622fc4-b48e-4599-a6de-b778fc685a3d-kube-api-access-qp5qm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.909991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622fc4-b48e-4599-a6de-b778fc685a3d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.910031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.910078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910154 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.910124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910349 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.910319 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910458 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.910438 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.910562 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.910539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.912299 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.912274 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622fc4-b48e-4599-a6de-b778fc685a3d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.912445 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.912430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622fc4-b48e-4599-a6de-b778fc685a3d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:55.917617 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:55.917599 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5qm\" (UniqueName: \"kubernetes.io/projected/6f622fc4-b48e-4599-a6de-b778fc685a3d-kube-api-access-qp5qm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xq987\" (UID: \"6f622fc4-b48e-4599-a6de-b778fc685a3d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:56.038317 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:56.038256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:52:56.169918 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:56.169897 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987"] Jul 09 03:52:56.172119 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:52:56.172086 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f622fc4_b48e_4599_a6de_b778fc685a3d.slice/crio-8bc12a18ad2d0137d0d181b67c6eea1cd0e92d9de57337b28c0c6b6fe3e0d475 WatchSource:0}: Error finding container 8bc12a18ad2d0137d0d181b67c6eea1cd0e92d9de57337b28c0c6b6fe3e0d475: Status 404 returned error can't find the container with id 8bc12a18ad2d0137d0d181b67c6eea1cd0e92d9de57337b28c0c6b6fe3e0d475 Jul 09 03:52:56.173526 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:56.173509 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 03:52:56.538327 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:56.538286 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" event={"ID":"6f622fc4-b48e-4599-a6de-b778fc685a3d","Type":"ContainerStarted","Data":"8bc12a18ad2d0137d0d181b67c6eea1cd0e92d9de57337b28c0c6b6fe3e0d475"} Jul 09 03:52:57.550343 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:57.550245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" event={"ID":"6f622fc4-b48e-4599-a6de-b778fc685a3d","Type":"ContainerStarted","Data":"d596c96a645ff620660c114848767ca68360b2da21293d8a722e5cefc1803087"} Jul 09 03:52:57.566668 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:57.566621 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" podStartSLOduration=1.588846753 podStartE2EDuration="2.566608044s" totalImagesPullingTime="977.761291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:52:57.566155351 +0000 UTC m=+618.430765603" watchObservedRunningTime="2026-07-09 03:52:57.566608044 +0000 UTC m=+618.431218299" Jul 09 03:52:57.841208 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:52:57.841133 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:53:06.039394 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.039286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:53:06.039394 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.039385 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:53:06.051952 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.051928 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:53:06.329171 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.329087 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc"] Jul 09 03:53:06.333019 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.332995 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.335441 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.335421 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 03:53:06.342950 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.342928 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc"] Jul 09 03:53:06.504932 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.504901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.505068 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.504938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tljg9\" (UniqueName: \"kubernetes.io/projected/4678d288-f1cb-44e6-a101-ed8d1c370535-kube-api-access-tljg9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.505068 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.504966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.505068 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.505032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.505169 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.505073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.505169 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.505100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4678d288-f1cb-44e6-a101-ed8d1c370535-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.603882 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.603828 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xq987" Jul 09 03:53:06.606401 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606473 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606473 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4678d288-f1cb-44e6-a101-ed8d1c370535-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606622 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606680 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tljg9\" (UniqueName: \"kubernetes.io/projected/4678d288-f1cb-44e6-a101-ed8d1c370535-kube-api-access-tljg9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606680 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606774 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606756 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606825 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606804 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.606970 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.606948 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.608765 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.608743 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4678d288-f1cb-44e6-a101-ed8d1c370535-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.609050 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.609035 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4678d288-f1cb-44e6-a101-ed8d1c370535-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.613244 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.613219 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tljg9\" (UniqueName: \"kubernetes.io/projected/4678d288-f1cb-44e6-a101-ed8d1c370535-kube-api-access-tljg9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc\" (UID: \"4678d288-f1cb-44e6-a101-ed8d1c370535\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.643080 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.643061 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:06.772404 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:06.772381 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc"] Jul 09 03:53:06.774534 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:53:06.774509 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4678d288_f1cb_44e6_a101_ed8d1c370535.slice/crio-c0892237528612a4238862b6d30edf23cf376c1e42b82201f0480b02eb217a9f WatchSource:0}: Error finding container c0892237528612a4238862b6d30edf23cf376c1e42b82201f0480b02eb217a9f: Status 404 returned error can't find the container with id c0892237528612a4238862b6d30edf23cf376c1e42b82201f0480b02eb217a9f Jul 09 03:53:07.599125 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:07.599078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" event={"ID":"4678d288-f1cb-44e6-a101-ed8d1c370535","Type":"ContainerStarted","Data":"bf192368d9c0fda81f87abd33756ecbc8df73159e482901aaf62a075d5adc234"} Jul 09 03:53:07.599553 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:07.599129 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" event={"ID":"4678d288-f1cb-44e6-a101-ed8d1c370535","Type":"ContainerStarted","Data":"c0892237528612a4238862b6d30edf23cf376c1e42b82201f0480b02eb217a9f"} Jul 09 03:53:07.614789 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:07.614730 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" podStartSLOduration=1.4345515 podStartE2EDuration="1.614712135s" totalImagesPullingTime="180.160635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:53:07.613642713 +0000 UTC m=+628.478252970" watchObservedRunningTime="2026-07-09 03:53:07.614712135 +0000 UTC m=+628.479322371" Jul 09 03:53:08.834809 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:08.834767 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:53:16.644024 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:16.643983 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:16.644434 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:16.644040 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:16.656256 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:16.656234 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:17.661395 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:17.661344 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc" Jul 09 03:53:48.289562 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.289524 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bc9c54846-x7rnp"] Jul 09 03:53:48.293042 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.293022 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.296216 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.296200 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q95d2\"" Jul 09 03:53:48.296312 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.296201 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 03:53:48.299852 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.299824 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bc9c54846-x7rnp"] Jul 09 03:53:48.370497 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.370464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zq2\" (UniqueName: \"kubernetes.io/projected/4d83bf8e-51c5-45a8-85d2-e0eab2e77a75-kube-api-access-k8zq2\") pod \"authorino-bc9c54846-x7rnp\" (UID: \"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75\") " pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.370649 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.370512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d83bf8e-51c5-45a8-85d2-e0eab2e77a75-tls-cert\") pod \"authorino-bc9c54846-x7rnp\" (UID: \"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75\") " pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.471628 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.471582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zq2\" (UniqueName: \"kubernetes.io/projected/4d83bf8e-51c5-45a8-85d2-e0eab2e77a75-kube-api-access-k8zq2\") pod \"authorino-bc9c54846-x7rnp\" (UID: \"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75\") " pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.471801 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.471647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d83bf8e-51c5-45a8-85d2-e0eab2e77a75-tls-cert\") pod \"authorino-bc9c54846-x7rnp\" (UID: \"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75\") " pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.474094 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.474072 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d83bf8e-51c5-45a8-85d2-e0eab2e77a75-tls-cert\") pod \"authorino-bc9c54846-x7rnp\" (UID: \"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75\") " pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.478676 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.478650 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zq2\" (UniqueName: \"kubernetes.io/projected/4d83bf8e-51c5-45a8-85d2-e0eab2e77a75-kube-api-access-k8zq2\") pod \"authorino-bc9c54846-x7rnp\" (UID: \"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75\") " pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.603146 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.603080 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bc9c54846-x7rnp" Jul 09 03:53:48.736385 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.736323 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bc9c54846-x7rnp"] Jul 09 03:53:48.738757 ip-10-0-143-153 kubenswrapper[2556]: W0709 03:53:48.738729 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d83bf8e_51c5_45a8_85d2_e0eab2e77a75.slice/crio-400148918a326f5cadc89d3cb98d2e3980ce551b0acd8d91db271c1bc73569ea WatchSource:0}: Error finding container 400148918a326f5cadc89d3cb98d2e3980ce551b0acd8d91db271c1bc73569ea: Status 404 returned error can't find the container with id 400148918a326f5cadc89d3cb98d2e3980ce551b0acd8d91db271c1bc73569ea Jul 09 03:53:48.782938 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:48.782901 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bc9c54846-x7rnp" event={"ID":"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75","Type":"ContainerStarted","Data":"400148918a326f5cadc89d3cb98d2e3980ce551b0acd8d91db271c1bc73569ea"} Jul 09 03:53:49.789046 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:49.789006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bc9c54846-x7rnp" event={"ID":"4d83bf8e-51c5-45a8-85d2-e0eab2e77a75","Type":"ContainerStarted","Data":"6a0100204777e0ac1c0eefe31b6093d0ea5d44a9ff379faf07887bcb0e79fecf"} Jul 09 03:53:49.813413 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:53:49.813343 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bc9c54846-x7rnp" podStartSLOduration=1.3703965839999999 podStartE2EDuration="1.813303604s" totalImagesPullingTime="442.90702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:53:49.810328192 +0000 UTC m=+670.674938449" watchObservedRunningTime="2026-07-09 03:53:49.813303604 +0000 UTC m=+670.677913861" Jul 09 03:54:15.835685 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:54:15.835652 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:54:26.536613 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:54:26.536575 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:54:37.950474 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:54:37.950403 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:54:46.042159 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:54:46.042124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:54:58.032318 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:54:58.032278 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:55:23.730407 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:55:23.730347 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:55:35.630040 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:55:35.630003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:56:07.334391 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:56:07.334303 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:56:15.334421 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:56:15.334389 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:56:25.934541 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:56:25.934501 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:56:34.034578 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:56:34.034535 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:56:45.134257 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:56:45.134214 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:56:54.834497 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:56:54.834445 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:57:05.934307 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:57:05.934271 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:57:15.938036 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:57:15.938005 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:57:38.138216 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:57:38.138142 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:57:46.129527 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:57:46.129493 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:58:09.541703 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:58:09.541665 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:58:19.934689 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:58:19.934657 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:58:36.634031 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:58:36.633992 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:58:46.334104 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:58:46.334064 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:58:56.037938 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:58:56.037899 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:59:05.333395 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:59:05.333294 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:59:14.632433 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:59:14.632405 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 03:59:41.346808 ip-10-0-143-153 kubenswrapper[2556]: I0709 03:59:41.346772 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:01:11.439278 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:01:11.439245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:01:27.445636 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:01:27.445599 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:01:38.034283 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:01:38.034246 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:01:49.640011 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:01:49.639977 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:01:59.433117 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:01:59.433081 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:02:08.733704 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:02:08.733623 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:02:19.931918 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:02:19.931884 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:02:30.933078 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:02:30.933045 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:02:39.426753 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:02:39.426713 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:02:50.132392 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:02:50.132343 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:03:14.430899 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:03:14.430853 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:03:22.040644 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:03:22.040613 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:03:32.233627 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:03:32.233546 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:03:41.934854 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:03:41.934819 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:03:51.837919 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:03:51.837880 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:04:03.434247 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:04:03.434209 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:04:14.137906 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:04:14.137869 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:04:23.634918 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:04:23.634886 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:04:34.736786 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:04:34.736746 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:04:43.835984 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:04:43.835946 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:04:53.138810 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:04:53.138773 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:05:06.542013 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:05:06.541921 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:05:15.544582 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:05:15.544546 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:05:25.138807 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:05:25.138771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:05:37.634481 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:05:37.634443 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:05:49.839008 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:05:49.838972 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:05:58.638406 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:05:58.638371 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:06:10.644501 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:06:10.644461 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:06:22.532787 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:06:22.532750 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:06:33.435794 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:06:33.435716 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:06:41.131897 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:06:41.131860 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:06:54.135899 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:06:54.135856 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:07:03.135815 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:07:03.135781 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:07:13.041983 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:07:13.041901 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:07:30.039871 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:07:30.039835 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:07:40.540845 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:07:40.540809 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:07:49.340086 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:07:49.340051 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:07:59.431244 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:07:59.431210 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:09:18.431182 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:09:18.431149 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:09:27.542010 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:09:27.541972 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:09:38.943944 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:09:38.943868 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:09:47.842755 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:09:47.842720 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:10:18.436097 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:10:18.436058 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:10:52.937063 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:10:52.937030 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:11:09.630762 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:11:09.630661 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:11:19.742816 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:11:19.742780 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:11:28.644171 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:11:28.644133 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:12:05.444059 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:12:05.444030 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:13:14.141854 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:14.141815 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:13:25.447348 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:25.447310 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:13:29.224328 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.224297 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5"] Jul 09 04:13:29.227905 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.227884 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.230437 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.230419 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2eb6ca\"/\"openshift-service-ca.crt\"" Jul 09 04:13:29.231405 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.231377 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2eb6ca\"/\"test-model-2eb6ca-kserve-self-signed-certs\"" Jul 09 04:13:29.231405 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.231393 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2eb6ca\"/\"kube-root-ca.crt\"" Jul 09 04:13:29.231546 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.231402 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2eb6ca\"/\"default-dockercfg-5pr4z\"" Jul 09 04:13:29.237592 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.237571 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5"] Jul 09 04:13:29.246923 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.246903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438800c9-96c2-4237-b5d7-ab992248c56a-tls-certs\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.247059 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.246934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-model-cache\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.247059 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.246999 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-tmp-dir\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.247059 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.247029 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-dshm\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.247212 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.247081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-home\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.247212 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.247140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mxn\" (UniqueName: \"kubernetes.io/projected/438800c9-96c2-4237-b5d7-ab992248c56a-kube-api-access-26mxn\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.347760 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.347729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-tmp-dir\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.347914 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.347775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-dshm\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.347914 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.347818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-home\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.347914 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.347885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26mxn\" (UniqueName: \"kubernetes.io/projected/438800c9-96c2-4237-b5d7-ab992248c56a-kube-api-access-26mxn\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.348023 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.347953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438800c9-96c2-4237-b5d7-ab992248c56a-tls-certs\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.348023 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.347990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-model-cache\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.348213 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.348195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-tmp-dir\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.348281 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.348254 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-home\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.348336 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.348314 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-model-cache\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.350178 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.350153 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-dshm\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.350301 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.350276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438800c9-96c2-4237-b5d7-ab992248c56a-tls-certs\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.355517 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.355500 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mxn\" (UniqueName: \"kubernetes.io/projected/438800c9-96c2-4237-b5d7-ab992248c56a-kube-api-access-26mxn\") pod \"test-model-2eb6ca-kserve-58b786847f-jf6b5\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.537840 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.537774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:29.668684 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:29.668653 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5"] Jul 09 04:13:29.670502 ip-10-0-143-153 kubenswrapper[2556]: W0709 04:13:29.670473 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod438800c9_96c2_4237_b5d7_ab992248c56a.slice/crio-e52ddcfab7fe5efd5e04a7e7f9e1cd86bdab44f91f4223822cd674bee6afaca1 WatchSource:0}: Error finding container e52ddcfab7fe5efd5e04a7e7f9e1cd86bdab44f91f4223822cd674bee6afaca1: Status 404 returned error can't find the container with id e52ddcfab7fe5efd5e04a7e7f9e1cd86bdab44f91f4223822cd674bee6afaca1 Jul 09 04:13:30.378330 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:30.378296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" event={"ID":"438800c9-96c2-4237-b5d7-ab992248c56a","Type":"ContainerStarted","Data":"01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a"} Jul 09 04:13:30.378699 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:30.378335 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" event={"ID":"438800c9-96c2-4237-b5d7-ab992248c56a","Type":"ContainerStarted","Data":"e52ddcfab7fe5efd5e04a7e7f9e1cd86bdab44f91f4223822cd674bee6afaca1"} Jul 09 04:13:30.394844 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:30.394797 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" podStartSLOduration=1.3947798599999999 podStartE2EDuration="1.39477986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:13:30.393141787 +0000 UTC m=+1851.257752046" watchObservedRunningTime="2026-07-09 04:13:30.39477986 +0000 UTC m=+1851.259390511" Jul 09 04:13:33.547034 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:33.546992 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:13:39.538117 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:39.538040 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:39.538117 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:39.538110 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:39.550571 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:39.550551 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:40.437949 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:40.437921 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:13:51.427987 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.427948 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx"] Jul 09 04:13:51.432265 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.432242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.434734 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.434709 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2dbf5f\"/\"openshift-service-ca.crt\"" Jul 09 04:13:51.435786 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.435745 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2dbf5f\"/\"kube-root-ca.crt\"" Jul 09 04:13:51.436706 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.435750 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2dbf5f\"/\"default-dockercfg-79gjx\"" Jul 09 04:13:51.436706 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.435865 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2dbf5f\"/\"test-model-2dbf5f-kserve-self-signed-certs\"" Jul 09 04:13:51.439616 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.439584 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx"] Jul 09 04:13:51.553207 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.553168 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tls-certs\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.553404 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.553277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-home\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.553404 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.553318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rggzp\" (UniqueName: \"kubernetes.io/projected/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-kube-api-access-rggzp\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.553404 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.553343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-dshm\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.553580 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.553446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-model-cache\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.553580 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.553523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tmp-dir\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654032 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.653993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tls-certs\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654215 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-home\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654215 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rggzp\" (UniqueName: \"kubernetes.io/projected/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-kube-api-access-rggzp\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654215 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-dshm\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654215 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-model-cache\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654447 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tmp-dir\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654599 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654577 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-home\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654656 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654596 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-model-cache\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.654656 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.654644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tmp-dir\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.656444 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.656421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-dshm\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.656605 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.656586 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tls-certs\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.661646 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.661618 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rggzp\" (UniqueName: \"kubernetes.io/projected/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-kube-api-access-rggzp\") pod \"test-model-2dbf5f-kserve-69bbd4b755-cmxqx\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.743962 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.743903 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:13:51.873507 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:51.873477 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx"] Jul 09 04:13:51.876871 ip-10-0-143-153 kubenswrapper[2556]: W0709 04:13:51.876843 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9690186_15ab_4dfb_9afe_716a8ffbc4e6.slice/crio-7a94d7bc60bece56d7e79cd8e8d47af0aa8086797ab9a8aaf4f0669cff4cd069 WatchSource:0}: Error finding container 7a94d7bc60bece56d7e79cd8e8d47af0aa8086797ab9a8aaf4f0669cff4cd069: Status 404 returned error can't find the container with id 7a94d7bc60bece56d7e79cd8e8d47af0aa8086797ab9a8aaf4f0669cff4cd069 Jul 09 04:13:52.487530 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:52.487494 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" event={"ID":"f9690186-15ab-4dfb-9afe-716a8ffbc4e6","Type":"ContainerStarted","Data":"bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e"} Jul 09 04:13:52.487530 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:52.487543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" event={"ID":"f9690186-15ab-4dfb-9afe-716a8ffbc4e6","Type":"ContainerStarted","Data":"7a94d7bc60bece56d7e79cd8e8d47af0aa8086797ab9a8aaf4f0669cff4cd069"} Jul 09 04:13:52.502903 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:52.502858 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" podStartSLOduration=1.502841833 podStartE2EDuration="1.502841833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:13:52.502289316 +0000 UTC m=+1873.366899572" watchObservedRunningTime="2026-07-09 04:13:52.502841833 +0000 UTC m=+1873.367452089" Jul 09 04:13:55.338626 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:13:55.338593 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:14:01.745040 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:01.745008 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:14:01.745476 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:01.745132 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:14:01.757579 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:01.757554 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:14:02.546267 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:02.546240 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:14:12.217870 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:12.217836 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5"] Jul 09 04:14:12.446458 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:12.446422 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:14:13.115687 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:13.115644 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx"] Jul 09 04:14:25.442601 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:25.442553 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:14:27.238426 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.238392 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" podUID="438800c9-96c2-4237-b5d7-ab992248c56a" containerName="main" containerID="cri-o://01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a" gracePeriod=45 Jul 09 04:14:27.485620 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.485594 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:14:27.588485 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588408 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438800c9-96c2-4237-b5d7-ab992248c56a-tls-certs\") pod \"438800c9-96c2-4237-b5d7-ab992248c56a\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " Jul 09 04:14:27.588485 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588445 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-tmp-dir\") pod \"438800c9-96c2-4237-b5d7-ab992248c56a\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " Jul 09 04:14:27.588485 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588470 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26mxn\" (UniqueName: \"kubernetes.io/projected/438800c9-96c2-4237-b5d7-ab992248c56a-kube-api-access-26mxn\") pod \"438800c9-96c2-4237-b5d7-ab992248c56a\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " Jul 09 04:14:27.588731 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588552 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-dshm\") pod \"438800c9-96c2-4237-b5d7-ab992248c56a\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " Jul 09 04:14:27.588731 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588640 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-model-cache\") pod \"438800c9-96c2-4237-b5d7-ab992248c56a\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " Jul 09 04:14:27.588731 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588655 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "438800c9-96c2-4237-b5d7-ab992248c56a" (UID: "438800c9-96c2-4237-b5d7-ab992248c56a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:27.588731 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588679 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-home\") pod \"438800c9-96c2-4237-b5d7-ab992248c56a\" (UID: \"438800c9-96c2-4237-b5d7-ab992248c56a\") " Jul 09 04:14:27.588998 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588811 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-model-cache" (OuterVolumeSpecName: "model-cache") pod "438800c9-96c2-4237-b5d7-ab992248c56a" (UID: "438800c9-96c2-4237-b5d7-ab992248c56a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:27.588998 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.588964 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-home" (OuterVolumeSpecName: "home") pod "438800c9-96c2-4237-b5d7-ab992248c56a" (UID: "438800c9-96c2-4237-b5d7-ab992248c56a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:27.589086 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.589061 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-home\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:27.589086 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.589080 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-tmp-dir\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:27.589161 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.589095 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-model-cache\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:27.590825 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.590805 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438800c9-96c2-4237-b5d7-ab992248c56a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "438800c9-96c2-4237-b5d7-ab992248c56a" (UID: "438800c9-96c2-4237-b5d7-ab992248c56a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:14:27.590884 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.590810 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-dshm" (OuterVolumeSpecName: "dshm") pod "438800c9-96c2-4237-b5d7-ab992248c56a" (UID: "438800c9-96c2-4237-b5d7-ab992248c56a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:27.590917 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.590894 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438800c9-96c2-4237-b5d7-ab992248c56a-kube-api-access-26mxn" (OuterVolumeSpecName: "kube-api-access-26mxn") pod "438800c9-96c2-4237-b5d7-ab992248c56a" (UID: "438800c9-96c2-4237-b5d7-ab992248c56a"). InnerVolumeSpecName "kube-api-access-26mxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:14:27.658099 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.658071 2556 generic.go:356] "Generic (PLEG): container finished" podID="438800c9-96c2-4237-b5d7-ab992248c56a" containerID="01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a" exitCode=0 Jul 09 04:14:27.658245 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.658172 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" Jul 09 04:14:27.663055 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.663026 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" event={"ID":"438800c9-96c2-4237-b5d7-ab992248c56a","Type":"ContainerDied","Data":"01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a"} Jul 09 04:14:27.663055 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.663060 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5" event={"ID":"438800c9-96c2-4237-b5d7-ab992248c56a","Type":"ContainerDied","Data":"e52ddcfab7fe5efd5e04a7e7f9e1cd86bdab44f91f4223822cd674bee6afaca1"} Jul 09 04:14:27.663258 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.663081 2556 scope.go:117] "RemoveContainer" containerID="01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a" Jul 09 04:14:27.672635 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.672616 2556 scope.go:117] "RemoveContainer" containerID="01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a" Jul 09 04:14:27.672880 ip-10-0-143-153 kubenswrapper[2556]: E0709 04:14:27.672863 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a\": container with ID starting with 01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a not found: ID does not exist" containerID="01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a" Jul 09 04:14:27.672927 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.672889 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a"} err="failed to get container status \"01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a\": rpc error: code = NotFound desc = could not find container \"01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a\": container with ID starting with 01a256d5aa05590b3c32f209764df33c57eb2ed4a7a4e688247ef2961e4b622a not found: ID does not exist" Jul 09 04:14:27.681977 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.681949 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5"] Jul 09 04:14:27.683858 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.683837 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2eb6ca/test-model-2eb6ca-kserve-58b786847f-jf6b5"] Jul 09 04:14:27.690492 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.690472 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26mxn\" (UniqueName: \"kubernetes.io/projected/438800c9-96c2-4237-b5d7-ab992248c56a-kube-api-access-26mxn\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:27.690563 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.690494 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438800c9-96c2-4237-b5d7-ab992248c56a-dshm\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:27.690563 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:27.690506 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438800c9-96c2-4237-b5d7-ab992248c56a-tls-certs\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.139289 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.139245 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" podUID="f9690186-15ab-4dfb-9afe-716a8ffbc4e6" containerName="main" containerID="cri-o://bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e" gracePeriod=45 Jul 09 04:14:28.389463 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.389413 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:14:28.498849 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.498810 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tmp-dir\") pod \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " Jul 09 04:14:28.499019 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.498865 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-model-cache\") pod \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " Jul 09 04:14:28.499019 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.498882 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-home\") pod \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " Jul 09 04:14:28.499019 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.498923 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rggzp\" (UniqueName: \"kubernetes.io/projected/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-kube-api-access-rggzp\") pod \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " Jul 09 04:14:28.499019 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.498959 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-dshm\") pod \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " Jul 09 04:14:28.499019 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499020 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tls-certs\") pod \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\" (UID: \"f9690186-15ab-4dfb-9afe-716a8ffbc4e6\") " Jul 09 04:14:28.499276 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499154 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9690186-15ab-4dfb-9afe-716a8ffbc4e6" (UID: "f9690186-15ab-4dfb-9afe-716a8ffbc4e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:28.499276 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499168 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9690186-15ab-4dfb-9afe-716a8ffbc4e6" (UID: "f9690186-15ab-4dfb-9afe-716a8ffbc4e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:28.499276 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499199 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-home" (OuterVolumeSpecName: "home") pod "f9690186-15ab-4dfb-9afe-716a8ffbc4e6" (UID: "f9690186-15ab-4dfb-9afe-716a8ffbc4e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:28.499478 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499308 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tmp-dir\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.499478 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499330 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-model-cache\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.499478 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.499341 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-home\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.501190 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.501170 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-dshm" (OuterVolumeSpecName: "dshm") pod "f9690186-15ab-4dfb-9afe-716a8ffbc4e6" (UID: "f9690186-15ab-4dfb-9afe-716a8ffbc4e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:14:28.501268 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.501247 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-kube-api-access-rggzp" (OuterVolumeSpecName: "kube-api-access-rggzp") pod "f9690186-15ab-4dfb-9afe-716a8ffbc4e6" (UID: "f9690186-15ab-4dfb-9afe-716a8ffbc4e6"). InnerVolumeSpecName "kube-api-access-rggzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:14:28.501268 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.501260 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9690186-15ab-4dfb-9afe-716a8ffbc4e6" (UID: "f9690186-15ab-4dfb-9afe-716a8ffbc4e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:14:28.600133 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.600093 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rggzp\" (UniqueName: \"kubernetes.io/projected/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-kube-api-access-rggzp\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.600133 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.600126 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-dshm\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.600133 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.600138 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9690186-15ab-4dfb-9afe-716a8ffbc4e6-tls-certs\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\"" Jul 09 04:14:28.664723 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.664695 2556 generic.go:356] "Generic (PLEG): container finished" podID="f9690186-15ab-4dfb-9afe-716a8ffbc4e6" containerID="bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e" exitCode=0 Jul 09 04:14:28.664863 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.664740 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" Jul 09 04:14:28.664863 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.664760 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" event={"ID":"f9690186-15ab-4dfb-9afe-716a8ffbc4e6","Type":"ContainerDied","Data":"bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e"} Jul 09 04:14:28.664863 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.664786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx" event={"ID":"f9690186-15ab-4dfb-9afe-716a8ffbc4e6","Type":"ContainerDied","Data":"7a94d7bc60bece56d7e79cd8e8d47af0aa8086797ab9a8aaf4f0669cff4cd069"} Jul 09 04:14:28.664863 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.664802 2556 scope.go:117] "RemoveContainer" containerID="bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e" Jul 09 04:14:28.673195 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.673177 2556 scope.go:117] "RemoveContainer" containerID="bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e" Jul 09 04:14:28.673438 ip-10-0-143-153 kubenswrapper[2556]: E0709 04:14:28.673420 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e\": container with ID starting with bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e not found: ID does not exist" containerID="bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e" Jul 09 04:14:28.673490 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.673446 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e"} err="failed to get container status \"bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e\": rpc error: code = NotFound desc = could not find container \"bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e\": container with ID starting with bd7495e7d2e7b11ce27a85d1997bfac5034e3f3c899371f8fe41f679f09fcb3e not found: ID does not exist" Jul 09 04:14:28.684730 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.684680 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx"] Jul 09 04:14:28.686728 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:28.686708 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2dbf5f/test-model-2dbf5f-kserve-69bbd4b755-cmxqx"] Jul 09 04:14:29.662332 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:29.662302 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="438800c9-96c2-4237-b5d7-ab992248c56a" path="/var/lib/kubelet/pods/438800c9-96c2-4237-b5d7-ab992248c56a/volumes" Jul 09 04:14:29.662710 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:29.662696 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9690186-15ab-4dfb-9afe-716a8ffbc4e6" path="/var/lib/kubelet/pods/f9690186-15ab-4dfb-9afe-716a8ffbc4e6/volumes" Jul 09 04:14:59.743975 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:14:59.743943 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:15:14.734737 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:15:14.734696 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:15:32.642002 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:15:32.641926 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:15:43.630959 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:15:43.630927 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:15:56.549711 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:15:56.549676 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:16:11.338117 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:16:11.338079 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:19:10.439951 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:10.439921 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:19:20.742630 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:20.742598 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bc9c54846-x7rnp_4d83bf8e-51c5-45a8-85d2-e0eab2e77a75/authorino/0.log" Jul 09 04:19:22.539029 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:22.538993 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brvj9"] Jul 09 04:19:25.378085 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:25.378053 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rq8z4_cc7d0f87-d59b-4493-a138-db4676cabc0a/manager/0.log" Jul 09 04:19:26.146051 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:26.146021 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645c4d5897-cjhkm_b4c31377-bac2-42ac-84a0-453a854a02d3/copy-manifests/0.log" Jul 09 04:19:26.152018 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:26.151998 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645c4d5897-cjhkm_b4c31377-bac2-42ac-84a0-453a854a02d3/manager/0.log" Jul 09 04:19:27.601704 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:27.601670 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bc9c54846-x7rnp_4d83bf8e-51c5-45a8-85d2-e0eab2e77a75/authorino/0.log" Jul 09 04:19:27.960126 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:27.960096 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6tkpc_d3171d9d-9569-49e3-9361-ab1d901c428d/kuadrant-console-plugin/0.log" Jul 09 04:19:28.339503 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:28.339425 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-brvj9_fead40b5-21cb-49b2-8662-ed37958a2939/limitador/0.log" Jul 09 04:19:29.192082 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:29.192055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796d489b5-dq7tz_79fc74d7-1119-40a7-8909-c848f52757c4/kube-auth-proxy/0.log" Jul 09 04:19:29.423898 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:29.423870 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-86h7c_ed58fd18-cec4-48ca-8fa1-724ff7abeee1/payload-pre-processing/0.log" Jul 09 04:19:30.486606 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:30.486580 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xq987_6f622fc4-b48e-4599-a6de-b778fc685a3d/main/0.log" Jul 09 04:19:30.597164 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:30.597134 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9w6tc_4678d288-f1cb-44e6-a101-ed8d1c370535/main/0.log" Jul 09 04:19:37.818952 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:37.818920 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j55t4_c8a5f942-5372-49d7-9688-5a9cf98da450/global-pull-secret-syncer/0.log" Jul 09 04:19:38.031969 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:38.031934 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xphwl_2bd8b23d-7c67-4f46-848a-ebb2308ebd8a/konnectivity-agent/0.log" Jul 09 04:19:38.102930 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:38.102855 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-153.ec2.internal_2f89825e5b648488da5798c096dfd777/haproxy/0.log" Jul 09 04:19:43.701866 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:43.701835 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bc9c54846-x7rnp_4d83bf8e-51c5-45a8-85d2-e0eab2e77a75/authorino/0.log" Jul 09 04:19:43.793148 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:43.793123 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6tkpc_d3171d9d-9569-49e3-9361-ab1d901c428d/kuadrant-console-plugin/0.log" Jul 09 04:19:44.040408 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:44.040327 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-brvj9_fead40b5-21cb-49b2-8662-ed37958a2939/limitador/0.log" Jul 09 04:19:45.739722 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.739693 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/alertmanager/0.log" Jul 09 04:19:45.762612 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.762582 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/config-reloader/0.log" Jul 09 04:19:45.786680 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.786655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/kube-rbac-proxy-web/0.log" Jul 09 04:19:45.807975 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.807951 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/kube-rbac-proxy/0.log" Jul 09 04:19:45.830740 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.830720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/kube-rbac-proxy-metric/0.log" Jul 09 04:19:45.852814 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.852791 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/prom-label-proxy/0.log" Jul 09 04:19:45.880587 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:45.880568 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1e747d34-acd5-44bc-9393-701a3a9e4ce0/init-config-reloader/0.log" Jul 09 04:19:46.029811 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.029738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bbm8q_52806272-d79e-4781-bbbd-9f53de96d7bf/kube-state-metrics/0.log" Jul 09 04:19:46.051134 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.051115 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bbm8q_52806272-d79e-4781-bbbd-9f53de96d7bf/kube-rbac-proxy-main/0.log" Jul 09 04:19:46.075474 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.075458 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bbm8q_52806272-d79e-4781-bbbd-9f53de96d7bf/kube-rbac-proxy-self/0.log" Jul 09 04:19:46.104859 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.104828 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dbf87fb7d-gspbb_470276db-5765-4a7f-90db-2c5b09b05e81/metrics-server/0.log" Jul 09 04:19:46.131602 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.131574 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-l6dnd_b14aafa7-56e0-4bfc-a9f9-250661e28c90/monitoring-plugin/0.log" Jul 09 04:19:46.328792 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.328720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nslw9_513b7bad-fa15-4f51-a9b9-60bce0102413/node-exporter/0.log" Jul 09 04:19:46.349535 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.349514 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nslw9_513b7bad-fa15-4f51-a9b9-60bce0102413/kube-rbac-proxy/0.log" Jul 09 04:19:46.371657 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.371630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nslw9_513b7bad-fa15-4f51-a9b9-60bce0102413/init-textfile/0.log" Jul 09 04:19:46.398664 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.398643 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cjzbh_9ddaa1b3-2ec6-4665-a109-4289f39b3c35/kube-rbac-proxy-main/0.log" Jul 09 04:19:46.421507 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.421484 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cjzbh_9ddaa1b3-2ec6-4665-a109-4289f39b3c35/kube-rbac-proxy-self/0.log" Jul 09 04:19:46.442689 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.442672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cjzbh_9ddaa1b3-2ec6-4665-a109-4289f39b3c35/openshift-state-metrics/0.log" Jul 09 04:19:46.480506 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.480490 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/prometheus/0.log" Jul 09 04:19:46.505784 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.505765 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/config-reloader/0.log" Jul 09 04:19:46.528486 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.528465 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/thanos-sidecar/0.log" Jul 09 04:19:46.551607 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.551592 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/kube-rbac-proxy-web/0.log" Jul 09 04:19:46.572668 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.572651 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/kube-rbac-proxy/0.log" Jul 09 04:19:46.594035 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.593986 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/kube-rbac-proxy-thanos/0.log" Jul 09 04:19:46.615583 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.615566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bfb4e4c8-fc73-4df0-b54e-d5f52e0446e4/init-config-reloader/0.log" Jul 09 04:19:46.643404 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.643387 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-542jr_f2d2a6f4-ef97-424e-81bd-72542fabf0b1/prometheus-operator/0.log" Jul 09 04:19:46.661325 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.661308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-542jr_f2d2a6f4-ef97-424e-81bd-72542fabf0b1/kube-rbac-proxy/0.log" Jul 09 04:19:46.684870 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.684851 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-ntmrh_41e4af71-f589-48c0-b40e-d35dc41b419f/prometheus-operator-admission-webhook/0.log" Jul 09 04:19:46.787644 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.787621 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcd9b7454-xjbjw_4030c25f-816b-4da2-8c96-e0f578e9dc96/thanos-query/0.log" Jul 09 04:19:46.816237 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.816212 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcd9b7454-xjbjw_4030c25f-816b-4da2-8c96-e0f578e9dc96/kube-rbac-proxy-web/0.log" Jul 09 04:19:46.840378 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.840340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcd9b7454-xjbjw_4030c25f-816b-4da2-8c96-e0f578e9dc96/kube-rbac-proxy/0.log" Jul 09 04:19:46.863022 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.862970 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcd9b7454-xjbjw_4030c25f-816b-4da2-8c96-e0f578e9dc96/prom-label-proxy/0.log" Jul 09 04:19:46.888724 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.888702 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcd9b7454-xjbjw_4030c25f-816b-4da2-8c96-e0f578e9dc96/kube-rbac-proxy-rules/0.log" Jul 09 04:19:46.912219 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:46.912195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcd9b7454-xjbjw_4030c25f-816b-4da2-8c96-e0f578e9dc96/kube-rbac-proxy-metrics/0.log" Jul 09 04:19:48.192901 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.192868 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf"] Jul 09 04:19:48.193457 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.193438 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438800c9-96c2-4237-b5d7-ab992248c56a" containerName="main" Jul 09 04:19:48.193457 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.193458 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="438800c9-96c2-4237-b5d7-ab992248c56a" containerName="main" Jul 09 04:19:48.193557 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.193484 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9690186-15ab-4dfb-9afe-716a8ffbc4e6" containerName="main" Jul 09 04:19:48.193557 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.193490 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9690186-15ab-4dfb-9afe-716a8ffbc4e6" containerName="main" Jul 09 04:19:48.193650 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.193561 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9690186-15ab-4dfb-9afe-716a8ffbc4e6" containerName="main" Jul 09 04:19:48.193650 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.193569 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="438800c9-96c2-4237-b5d7-ab992248c56a" containerName="main" Jul 09 04:19:48.196789 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.196769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.199225 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.199204 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b9skj\"/\"openshift-service-ca.crt\"" Jul 09 04:19:48.199340 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.199264 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b9skj\"/\"kube-root-ca.crt\"" Jul 09 04:19:48.200268 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.200250 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b9skj\"/\"default-dockercfg-2zmlk\"" Jul 09 04:19:48.203086 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.203064 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf"] Jul 09 04:19:48.272744 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.272719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-lib-modules\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.272857 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.272791 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-podres\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.272857 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.272837 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-proc\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.272959 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.272924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-sys\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.272959 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.272952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pjg\" (UniqueName: \"kubernetes.io/projected/d47a52ab-934f-4e34-b6ac-f778fc97b667-kube-api-access-w7pjg\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373594 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-lib-modules\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373681 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-podres\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373681 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373645 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-proc\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373782 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-sys\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373782 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pjg\" (UniqueName: \"kubernetes.io/projected/d47a52ab-934f-4e34-b6ac-f778fc97b667-kube-api-access-w7pjg\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373782 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373737 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-podres\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373896 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373790 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-proc\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373896 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373795 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-sys\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.373896 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.373741 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d47a52ab-934f-4e34-b6ac-f778fc97b667-lib-modules\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.381800 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.381771 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pjg\" (UniqueName: \"kubernetes.io/projected/d47a52ab-934f-4e34-b6ac-f778fc97b667-kube-api-access-w7pjg\") pod \"perf-node-gather-daemonset-hs2hf\" (UID: \"d47a52ab-934f-4e34-b6ac-f778fc97b667\") " pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.508064 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.508013 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:48.636873 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:48.636849 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf"] Jul 09 04:19:48.638706 ip-10-0-143-153 kubenswrapper[2556]: W0709 04:19:48.638676 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd47a52ab_934f_4e34_b6ac_f778fc97b667.slice/crio-156805d4c7291a5f9d831b5d97434328f51c158afcce752530b6f548a7989923 WatchSource:0}: Error finding container 156805d4c7291a5f9d831b5d97434328f51c158afcce752530b6f548a7989923: Status 404 returned error can't find the container with id 156805d4c7291a5f9d831b5d97434328f51c158afcce752530b6f548a7989923 Jul 09 04:19:49.154453 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:49.154421 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" event={"ID":"d47a52ab-934f-4e34-b6ac-f778fc97b667","Type":"ContainerStarted","Data":"f2960f6f994174097f3d5cc8a0dfdac529f20273ab181e0b3e40b627f7dde7df"} Jul 09 04:19:49.154602 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:49.154472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" event={"ID":"d47a52ab-934f-4e34-b6ac-f778fc97b667","Type":"ContainerStarted","Data":"156805d4c7291a5f9d831b5d97434328f51c158afcce752530b6f548a7989923"} Jul 09 04:19:49.154602 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:49.154513 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:49.168693 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:49.168639 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" podStartSLOduration=1.168624873 podStartE2EDuration="1.168624873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:19:49.168223507 +0000 UTC m=+2230.032833764" watchObservedRunningTime="2026-07-09 04:19:49.168624873 +0000 UTC m=+2230.033235129" Jul 09 04:19:49.320518 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:49.320492 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9d88fc75-r7w6g_9a5cdef7-bdd5-4da5-a257-7cbe9d21402f/console/0.log" Jul 09 04:19:51.022037 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:51.022010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9h6bv_4d4df1af-8878-43f4-b212-7271c805b99e/dns/0.log" Jul 09 04:19:51.044748 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:51.044722 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9h6bv_4d4df1af-8878-43f4-b212-7271c805b99e/kube-rbac-proxy/0.log" Jul 09 04:19:51.164495 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:51.164459 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wrh8c_662fc5c2-7647-46ff-87bb-56c8ecea778d/dns-node-resolver/0.log" Jul 09 04:19:51.687099 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:51.687071 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-766ffc464c-9vmtx_7ffe74ae-76bc-4304-b0a9-058bc3f47f6a/registry/0.log" Jul 09 04:19:51.733763 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:51.733737 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sf4hd_840c6d20-4e3a-401f-ba09-7051a26164ec/node-ca/0.log" Jul 09 04:19:52.964913 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:52.964877 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796d489b5-dq7tz_79fc74d7-1119-40a7-8909-c848f52757c4/kube-auth-proxy/0.log" Jul 09 04:19:53.062034 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:53.062003 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-86h7c_ed58fd18-cec4-48ca-8fa1-724ff7abeee1/payload-pre-processing/0.log" Jul 09 04:19:53.830846 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:53.830816 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4b998_999bfc7d-3bba-4a24-9164-4ea904ee6d20/serve-healthcheck-canary/0.log" Jul 09 04:19:54.526249 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:54.526223 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ml6k2_0ec30039-dbd0-4618-b240-5be7fd9f219e/kube-rbac-proxy/0.log" Jul 09 04:19:54.550204 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:54.550181 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ml6k2_0ec30039-dbd0-4618-b240-5be7fd9f219e/exporter/0.log" Jul 09 04:19:54.574472 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:54.574453 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ml6k2_0ec30039-dbd0-4618-b240-5be7fd9f219e/extractor/0.log" Jul 09 04:19:55.169372 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:55.169332 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b9skj/perf-node-gather-daemonset-hs2hf" Jul 09 04:19:56.864162 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:56.864132 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rq8z4_cc7d0f87-d59b-4493-a138-db4676cabc0a/manager/0.log" Jul 09 04:19:57.335113 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:57.335084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645c4d5897-cjhkm_b4c31377-bac2-42ac-84a0-453a854a02d3/manager/0.log" Jul 09 04:19:57.358456 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:57.358431 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645c4d5897-cjhkm_b4c31377-bac2-42ac-84a0-453a854a02d3/copy-manifests/0.log" Jul 09 04:19:58.799413 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:58.799352 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f5f9c4b6d-r9cbt_beba24eb-2e74-4157-b750-af2a746c1728/manager/0.log" Jul 09 04:19:59.270606 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:59.270576 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796d489b5-dq7tz_79fc74d7-1119-40a7-8909-c848f52757c4/kube-auth-proxy/0.log" Jul 09 04:19:59.348604 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:19:59.348573 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-86h7c_ed58fd18-cec4-48ca-8fa1-724ff7abeee1/payload-pre-processing/0.log" Jul 09 04:20:00.825401 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:00.825352 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796d489b5-dq7tz_79fc74d7-1119-40a7-8909-c848f52757c4/kube-auth-proxy/0.log" Jul 09 04:20:00.914671 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:00.914637 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-86h7c_ed58fd18-cec4-48ca-8fa1-724ff7abeee1/payload-pre-processing/0.log" Jul 09 04:20:05.774780 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.774746 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/kube-multus-additional-cni-plugins/0.log" Jul 09 04:20:05.799070 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.799042 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/egress-router-binary-copy/0.log" Jul 09 04:20:05.821783 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.821763 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/cni-plugins/0.log" Jul 09 04:20:05.845626 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.845605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/bond-cni-plugin/0.log" Jul 09 04:20:05.870396 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.870375 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/routeoverride-cni/0.log" Jul 09 04:20:05.892973 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.892955 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/whereabouts-cni-bincopy/0.log" Jul 09 04:20:05.915600 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.915569 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmbqj_0cb6747e-e5de-4778-92ea-614a0f675765/whereabouts-cni/0.log" Jul 09 04:20:05.983511 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:05.983488 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s89mf_b5e0c420-339d-476d-8f76-965c1a8405a1/kube-multus/0.log" Jul 09 04:20:06.104495 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:06.104405 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tdxld_71fd99dc-32ba-48c0-98af-e66994b90329/network-metrics-daemon/0.log" Jul 09 04:20:06.152038 ip-10-0-143-153 kubenswrapper[2556]: I0709 04:20:06.152005 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tdxld_71fd99dc-32ba-48c0-98af-e66994b90329/kube-rbac-proxy/0.log"