Jul 09 13:56:05.932730 ip-10-0-136-155 systemd[1]: Starting Kubernetes Kubelet... Jul 09 13:56:06.376931 ip-10-0-136-155 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:56:06.376931 ip-10-0-136-155 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 13:56:06.376931 ip-10-0-136-155 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:56:06.376931 ip-10-0-136-155 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 13:56:06.376931 ip-10-0-136-155 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:56:06.377736 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.377648 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 13:56:06.383458 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383423 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:56:06.383458 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383460 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:56:06.383458 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383464 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:56:06.383458 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383467 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383470 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383473 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383475 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383480 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383483 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383485 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383488 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383491 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383493 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383496 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383498 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383501 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383503 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383506 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383508 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383511 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383513 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383516 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383518 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:56:06.383647 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383528 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383531 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383533 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383536 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383538 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383541 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383543 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383546 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383548 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383551 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383553 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383555 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383558 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383561 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383564 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383568 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383570 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383573 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383577 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383581 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:56:06.384127 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383585 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383587 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383590 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383592 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383595 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383597 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383600 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383603 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383607 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383611 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383614 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383616 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383619 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383622 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383625 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383627 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383630 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383632 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383634 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383637 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:56:06.384640 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383639 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383641 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383644 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383646 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383649 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383651 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383656 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383658 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383661 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383664 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383667 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383670 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383673 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383676 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383678 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383681 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383683 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383687 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383690 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:56:06.385131 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383693 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383696 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383698 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383701 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383703 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383705 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383708 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383711 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383713 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383716 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383718 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383721 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383723 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383726 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383728 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383731 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.383733 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384485 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384494 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:56:06.385608 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384497 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384500 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384503 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384506 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384509 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384511 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384514 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384516 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384519 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384521 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384524 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384526 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384529 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384532 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384534 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384537 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384540 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384543 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384545 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:56:06.386068 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384548 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384553 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384556 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384560 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384562 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384565 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384568 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384571 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384574 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384576 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384579 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384582 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384584 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384588 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384592 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384595 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384598 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384600 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384603 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384606 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:56:06.386555 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384609 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384612 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384615 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384618 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384621 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384624 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384626 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384629 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384632 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384635 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384637 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384640 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384642 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384645 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384648 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384650 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384653 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384655 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384658 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384661 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:56:06.387053 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384663 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384665 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384669 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384672 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384675 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384679 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384682 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384685 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384687 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384690 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384693 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384695 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384698 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384701 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384703 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384706 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384709 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384711 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384714 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:56:06.387575 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384717 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384719 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384721 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384725 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384727 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384729 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384732 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384735 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384739 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384741 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384744 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384746 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384748 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384751 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384754 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384756 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384759 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384762 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.384767 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385164 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:56:06.388042 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385168 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385171 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385174 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385178 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385182 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385185 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385188 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385191 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385194 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385197 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385199 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385202 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385204 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385207 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385209 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385212 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385215 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385217 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385220 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385223 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:56:06.388569 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385225 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385228 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385230 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385233 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385235 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385238 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385240 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385242 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385245 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385248 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385252 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385255 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385257 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385260 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385262 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385264 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385267 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385270 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385272 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385274 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:56:06.389056 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385277 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385279 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385283 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385286 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385289 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385291 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385294 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385297 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385300 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385303 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385305 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385308 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385310 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385313 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385315 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385318 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385331 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385334 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385336 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:56:06.389547 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385338 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385341 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385343 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385347 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385351 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385354 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385357 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385360 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385362 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385365 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385367 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385370 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385372 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385374 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385377 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385380 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385384 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385386 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385389 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385391 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:56:06.390049 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385394 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385396 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385400 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385402 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385404 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385407 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385409 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385412 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385414 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385417 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385420 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385422 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385425 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385427 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385430 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385434 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385436 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385454 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.385457 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385543 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 13:56:06.390578 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385564 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385572 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385578 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385585 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385588 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385593 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385598 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385601 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385604 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385607 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385611 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385614 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385617 2559 flags.go:64] FLAG: --cgroup-root="" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385620 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385623 2559 flags.go:64] FLAG: --client-ca-file="" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385627 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385630 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385634 2559 flags.go:64] FLAG: --cluster-domain="" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385637 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385640 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385643 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385647 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385650 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 13:56:06.391046 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385653 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385656 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385660 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385663 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385667 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385669 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385672 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385675 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385679 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385682 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385685 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385688 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385691 2559 flags.go:64] FLAG: --enable-server="true" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385694 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385698 2559 flags.go:64] FLAG: --event-burst="100" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385701 2559 flags.go:64] FLAG: --event-qps="50" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385704 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385707 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385710 2559 flags.go:64] FLAG: --eviction-hard="" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385714 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385717 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385720 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385722 2559 flags.go:64] FLAG: --eviction-soft="" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385725 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385728 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 13:56:06.391651 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385731 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385734 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385737 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385740 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385742 2559 flags.go:64] FLAG: --feature-gates="" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385746 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385749 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385752 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385754 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385757 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385760 2559 flags.go:64] FLAG: --help="false" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385763 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385766 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385769 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385772 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385775 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385778 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385781 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385784 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385786 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385789 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385792 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385795 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385797 2559 flags.go:64] FLAG: --kube-reserved="" Jul 09 13:56:06.392264 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385800 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385803 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385806 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385808 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385811 2559 flags.go:64] FLAG: --lock-file="" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385814 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385816 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385819 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385827 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385831 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385834 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385837 2559 flags.go:64] FLAG: --logging-format="text" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385839 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385842 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385845 2559 flags.go:64] FLAG: --manifest-url="" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385848 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385852 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385855 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385859 2559 flags.go:64] FLAG: --max-pods="110" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385861 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385864 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385867 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385870 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385873 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385876 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 13:56:06.393104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385878 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385885 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385889 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385891 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385894 2559 flags.go:64] FLAG: --pod-cidr="" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385897 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385902 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385905 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385908 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385911 2559 flags.go:64] FLAG: --port="10250" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385914 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385917 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-077de162a9fd66c6f" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385920 2559 flags.go:64] FLAG: --qos-reserved="" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385923 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385925 2559 flags.go:64] FLAG: --register-node="true" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385928 2559 flags.go:64] FLAG: --register-with-taints="" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385934 2559 flags.go:64] FLAG: --registry-burst="10" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385937 2559 flags.go:64] FLAG: --registry-qps="5" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385940 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385942 2559 flags.go:64] FLAG: --reserved-memory="" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385946 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385949 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385952 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385955 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385957 2559 flags.go:64] FLAG: --runonce="false" Jul 09 13:56:06.394174 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385960 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385963 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385966 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385968 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385971 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385974 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385977 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385980 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385982 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385985 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385988 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385990 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385993 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385996 2559 flags.go:64] FLAG: --system-cgroups="" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.385999 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386004 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386006 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386009 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386016 2559 flags.go:64] FLAG: --tls-min-version="" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386019 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386021 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386024 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386027 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386031 2559 flags.go:64] FLAG: --v="2" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386035 2559 flags.go:64] FLAG: --version="false" Jul 09 13:56:06.395343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386040 2559 flags.go:64] FLAG: --vmodule="" Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386044 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.386047 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386184 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386189 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386192 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386194 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386197 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386200 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386202 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386205 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386207 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386210 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386212 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386214 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386217 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386220 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386222 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386224 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386227 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:56:06.396607 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386229 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386232 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386234 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386237 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386239 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386246 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386249 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386251 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386254 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386257 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386261 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386263 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386266 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386269 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386272 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386275 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386277 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386280 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386282 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386284 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:56:06.397232 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386287 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386289 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386292 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386294 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386297 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386299 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386302 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386304 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386307 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386309 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386312 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386314 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386317 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386320 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386322 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386325 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386327 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386330 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386333 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:56:06.397954 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386336 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386341 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386345 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386350 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386354 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386356 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386359 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386362 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386365 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386368 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386370 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386373 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386376 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386378 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386381 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386383 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386386 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386389 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:56:06.398663 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386391 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386393 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386396 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386399 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386401 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386404 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386406 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386408 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386411 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386413 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386416 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386418 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386422 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386425 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386427 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386430 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386432 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386435 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386453 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386456 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:56:06.399104 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386460 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386462 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386465 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386468 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.386470 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.387179 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.395239 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.395268 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.395296 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.395305 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395397 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395409 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395414 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395418 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:56:06.399919 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395423 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395428 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395432 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395436 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395464 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395468 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395471 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395475 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395479 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395483 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395486 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395490 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395494 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395497 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395501 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395505 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395508 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395512 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395516 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395519 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:56:06.400305 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395523 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395527 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395530 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395534 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395537 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395551 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395555 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395560 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395563 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395568 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395571 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395576 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395582 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395587 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395591 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395595 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395599 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395603 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395607 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395611 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:56:06.400941 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395616 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395619 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395623 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395627 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395631 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395635 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395639 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395644 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395648 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395653 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395657 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395661 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395665 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395669 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395674 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395678 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395682 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395687 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395700 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395704 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:56:06.401526 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395708 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395712 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395717 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395721 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395725 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395729 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395733 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395737 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395741 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395746 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395750 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395754 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395758 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395762 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395766 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395770 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395774 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395778 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395782 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395786 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:56:06.402009 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395791 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395795 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395799 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395803 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395807 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395814 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395820 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395825 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395829 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395834 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395838 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395851 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395856 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395861 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:56:06.402582 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.395865 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.395874 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396119 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396129 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396135 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396140 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396144 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396148 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396153 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396157 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396161 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396165 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396169 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396173 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:56:06.402920 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396177 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396181 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396185 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396189 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396193 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396198 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396202 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396207 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396211 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396215 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396219 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396223 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396227 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396232 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396236 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396240 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396252 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396256 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396260 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396264 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:56:06.403260 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396268 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396272 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396276 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396281 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396285 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396289 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396293 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396298 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396302 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396306 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396310 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396314 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396318 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396322 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396326 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396331 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396335 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396339 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396343 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396348 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396352 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:56:06.403852 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396356 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396360 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396364 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396368 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396374 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396380 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396385 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396389 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396403 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396408 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396412 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396415 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396419 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396423 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396427 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396431 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396435 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396459 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396464 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:56:06.404375 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396469 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396474 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396479 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396483 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396487 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396491 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396495 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396499 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396503 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396507 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396511 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396517 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396522 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396527 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396531 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396535 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396540 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396544 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396549 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:56:06.404858 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396553 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396558 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396562 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396574 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396579 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396583 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396588 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:06.396592 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.396600 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.396804 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.400547 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.402280 2559 server.go:1019] "Starting client certificate rotation" Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.402394 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:56:06.405315 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.402436 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:56:06.406055 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.406038 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:56:06.409230 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.409206 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:56:06.419346 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.419326 2559 log.go:25] "Validated CRI v1 runtime API" Jul 09 13:56:06.422327 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.422311 2559 log.go:25] "Validated CRI v1 image API" Jul 09 13:56:06.423979 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.423963 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 13:56:06.427489 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.427469 2559 fs.go:135] Filesystem UUIDs: map[2b2642d9-c219-45d8-8542-dd348f59658c:/dev/nvme0n1p3 588557ea-751d-4f2b-b1bf-d4ad16a8ebda:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 13:56:06.427561 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.427489 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 13:56:06.432607 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.432486 2559 manager.go:216] Machine: {Timestamp:2026-07-09 13:56:06.431132276 +0000 UTC m=+0.375740012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099498 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2611518df83b8d180ea163296a3a75 SystemUUID:ec261151-8df8-3b8d-180e-a163296a3a75 BootID:abb02688-01bb-40ed-b005-427896b3c261 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:a9:8c:a0:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:a9:8c:a0:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:4c:7a:d9:1e:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 13:56:06.432607 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.432599 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 13:56:06.432772 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.432711 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 13:56:06.435736 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.435720 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:56:06.436396 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.436366 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 13:56:06.436561 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.436401 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-155.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 13:56:06.437156 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.437147 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 13:56:06.437185 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.437160 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 13:56:06.437185 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.437167 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:56:06.437786 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.437774 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:56:06.439151 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.439141 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 13:56:06.442335 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442323 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:56:06.442484 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442475 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 13:56:06.442518 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442505 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 09 13:56:06.442518 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442515 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 13:56:06.442598 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442590 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 13:56:06.442646 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442603 2559 kubelet.go:398] "Adding apiserver pod source" Jul 09 13:56:06.442646 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.442613 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 13:56:06.443033 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.443019 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:56:06.443075 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.443047 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:56:06.445629 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.445591 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 13:56:06.447752 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.447737 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 13:56:06.447816 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.447767 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 13:56:06.448944 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448933 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 13:56:06.448981 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448950 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 13:56:06.448981 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448956 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 13:56:06.448981 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448961 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 13:56:06.448981 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448970 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 13:56:06.448981 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448975 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 13:56:06.448981 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448983 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 13:56:06.449181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448988 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 13:56:06.449181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448994 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 13:56:06.449181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.448999 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 13:56:06.449181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.449016 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 13:56:06.449181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.449021 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 13:56:06.450819 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.450801 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 13:56:06.450908 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.450830 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 13:56:06.454852 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.454826 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-155.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 13:56:06.454852 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.454829 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 13:56:06.454852 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.454824 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 13:56:06.455219 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.455205 2559 server.go:1268] "Started kubelet" Jul 09 13:56:06.455341 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.455288 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 13:56:06.455405 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.455348 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 13:56:06.455493 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.455471 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 13:56:06.456210 ip-10-0-136-155 systemd[1]: Started Kubernetes Kubelet. Jul 09 13:56:06.457288 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.457276 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 09 13:56:06.457642 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.457628 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 13:56:06.462369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.462351 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 13:56:06.463399 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.462497 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-155.ec2.internal.18c0a3a17f0a1b18 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-155.ec2.internal,UID:ip-10-0-136-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-155.ec2.internal,},FirstTimestamp:2026-07-09 13:56:06.455147288 +0000 UTC m=+0.399755024,LastTimestamp:2026-07-09 13:56:06.455147288 +0000 UTC m=+0.399755024,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-155.ec2.internal,}" Jul 09 13:56:06.464028 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464007 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vtzsx" Jul 09 13:56:06.464109 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464069 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 13:56:06.464158 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464110 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 13:56:06.464299 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.464282 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:06.464744 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464726 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 13:56:06.464840 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464754 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 13:56:06.464840 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464765 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 13:56:06.464840 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464823 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 09 13:56:06.464840 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464831 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 09 13:56:06.464987 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464893 2559 factory.go:55] Registering systemd factory Jul 09 13:56:06.464987 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.464908 2559 factory.go:223] Registration of the systemd container factory successfully Jul 09 13:56:06.465123 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.465108 2559 factory.go:153] Registering CRI-O factory Jul 09 13:56:06.465123 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.465124 2559 factory.go:223] Registration of the crio container factory successfully Jul 09 13:56:06.465262 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.465168 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 13:56:06.465262 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.465187 2559 factory.go:103] Registering Raw factory Jul 09 13:56:06.465262 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.465200 2559 manager.go:1196] Started watching for new ooms in manager Jul 09 13:56:06.465892 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.465878 2559 manager.go:349] Starting recovery of all containers Jul 09 13:56:06.468362 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.468336 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 13:56:06.468719 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.468642 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 13:56:06.472169 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.472147 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vtzsx" Jul 09 13:56:06.476906 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.476746 2559 manager.go:354] Recovery completed Jul 09 13:56:06.479087 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.479068 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 09 13:56:06.482018 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.482006 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.483903 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.483885 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.483982 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.483916 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.483982 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.483927 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.484500 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.484486 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 13:56:06.484500 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.484491 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.484634 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.484497 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 13:56:06.484634 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.484533 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:56:06.485246 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.485230 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.485301 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.485256 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.485301 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.485266 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.485613 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.485602 2559 policy_none.go:49] "None policy: Start" Jul 09 13:56:06.485657 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.485617 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 13:56:06.485657 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.485629 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 13:56:06.486024 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.485959 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-155.ec2.internal.18c0a3a180c0dab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-155.ec2.internal,UID:ip-10-0-136-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-155.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-155.ec2.internal,},FirstTimestamp:2026-07-09 13:56:06.483901108 +0000 UTC m=+0.428508863,LastTimestamp:2026-07-09 13:56:06.483901108 +0000 UTC m=+0.428508863,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-155.ec2.internal,}" Jul 09 13:56:06.486984 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.486969 2559 policy_none.go:47] "Start" Jul 09 13:56:06.532014 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.531999 2559 manager.go:337] "Starting Device Plugin manager" Jul 09 13:56:06.532098 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.532039 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 13:56:06.532098 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.532051 2559 server.go:87] "Starting device plugin registration server" Jul 09 13:56:06.532280 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.532267 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 13:56:06.532375 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.532283 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 13:56:06.532435 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.532386 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 13:56:06.532500 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.532477 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 13:56:06.532500 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.532486 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 13:56:06.534489 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.534464 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 13:56:06.534566 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.534522 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:06.632971 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.632902 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.634116 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.633993 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.634116 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.634028 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.634116 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.634045 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.634116 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.634079 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.638283 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.638252 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 13:56:06.639627 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.639614 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 13:56:06.639686 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.639647 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 13:56:06.639686 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.639674 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 13:56:06.639765 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.639705 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 13:56:06.641977 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.641958 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:56:06.642286 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.642268 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.642329 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.642298 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-155.ec2.internal\": node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:06.692522 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.692494 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:06.740613 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.740584 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal"] Jul 09 13:56:06.740712 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.740663 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.743015 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.743000 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.743103 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.743033 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.743103 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.743049 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.744514 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.744499 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.744625 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.744609 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.744690 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.744649 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.745469 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.745437 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.745540 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.745434 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.745540 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.745505 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.745540 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.745518 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.745540 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.745481 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.745715 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.745564 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.746773 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.746756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.746858 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.746787 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:56:06.747410 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.747395 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:56:06.747498 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.747419 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:56:06.747498 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.747432 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:56:06.766976 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.766957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bd818ee0caf1d1922453acfe179c146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"3bd818ee0caf1d1922453acfe179c146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.767051 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.766979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd818ee0caf1d1922453acfe179c146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"3bd818ee0caf1d1922453acfe179c146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.767051 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.766994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34d1f1a8876ffc091a8781eb04b08c52-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"34d1f1a8876ffc091a8781eb04b08c52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.772982 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.772968 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-155.ec2.internal\" not found" node="ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.777188 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.777172 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-155.ec2.internal\" not found" node="ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.792961 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.792936 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:06.867228 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.867200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bd818ee0caf1d1922453acfe179c146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"3bd818ee0caf1d1922453acfe179c146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.867329 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.867233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd818ee0caf1d1922453acfe179c146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"3bd818ee0caf1d1922453acfe179c146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.867329 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.867253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34d1f1a8876ffc091a8781eb04b08c52-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"34d1f1a8876ffc091a8781eb04b08c52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.867407 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.867325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34d1f1a8876ffc091a8781eb04b08c52-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"34d1f1a8876ffc091a8781eb04b08c52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.867407 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.867353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd818ee0caf1d1922453acfe179c146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"3bd818ee0caf1d1922453acfe179c146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.867407 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:06.867325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bd818ee0caf1d1922453acfe179c146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"3bd818ee0caf1d1922453acfe179c146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:06.894062 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.894008 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:06.994824 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:06.994797 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.077289 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.077252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:07.081650 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.081413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:56:07.095392 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.095373 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.196854 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.196766 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.281990 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.281964 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:56:07.297150 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.297120 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.398725 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.398679 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.400959 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.400939 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 13:56:07.401128 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.401101 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:56:07.401195 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.401166 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:56:07.475171 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.475019 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:51:06 +0000 UTC" deadline="2028-04-18 14:00:27.158352734 +0000 UTC" Jul 09 13:56:07.475171 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.475091 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15576h4m19.683267131s" Jul 09 13:56:07.499460 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.499399 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.600566 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.600512 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.701429 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:07.701399 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:56:07.702038 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.702019 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:56:07.726203 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.726139 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:56:07.764705 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.764675 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:56:07.766516 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:07.766479 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd818ee0caf1d1922453acfe179c146.slice/crio-0f6286155ae558197db05d9a70a4d79d064a2f5de35f24f1978df83a12abe534 WatchSource:0}: Error finding container 0f6286155ae558197db05d9a70a4d79d064a2f5de35f24f1978df83a12abe534: Status 404 returned error can't find the container with id 0f6286155ae558197db05d9a70a4d79d064a2f5de35f24f1978df83a12abe534 Jul 09 13:56:07.767219 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:07.767197 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d1f1a8876ffc091a8781eb04b08c52.slice/crio-3f9d1a510d228bfa04a980761c1d6974a0cea7d56962625f2d1da314728035b3 WatchSource:0}: Error finding container 3f9d1a510d228bfa04a980761c1d6974a0cea7d56962625f2d1da314728035b3: Status 404 returned error can't find the container with id 3f9d1a510d228bfa04a980761c1d6974a0cea7d56962625f2d1da314728035b3 Jul 09 13:56:07.773045 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.773019 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:56:07.789000 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.788970 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:56:07.790008 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.789992 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:56:07.807412 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:07.807389 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:56:08.444084 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.444049 2559 apiserver.go:52] "Watching apiserver" Jul 09 13:56:08.454551 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.454530 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 13:56:08.454946 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.454923 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-wr6gb","kube-system/global-pull-secret-syncer-zl2xb","kube-system/konnectivity-agent-2rhl9","kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq","openshift-cluster-node-tuning-operator/tuned-rbgrj","openshift-image-registry/node-ca-xqhnt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal","openshift-multus/multus-8w6bd","openshift-dns/node-resolver-gslzq","openshift-multus/multus-additional-cni-plugins-85gcq","openshift-multus/network-metrics-daemon-6wrzb","openshift-network-diagnostics/network-check-target-fq27s","openshift-network-operator/iptables-alerter-8rpmx"] Jul 09 13:56:08.455972 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.455954 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:56:08.457445 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.457426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.458781 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.458764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:08.458892 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.458825 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:08.459973 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.459934 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.460176 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.460111 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.460252 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.460198 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w2fbl\"" Jul 09 13:56:08.460505 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.460488 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.461972 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.461949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.462688 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.462666 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 13:56:08.462901 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.462882 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cfmng\"" Jul 09 13:56:08.462969 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.462936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 13:56:08.463435 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.463357 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.464347 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.464327 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 13:56:08.464428 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.464380 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.464560 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.464541 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 13:56:08.464636 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.464602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b5mht\"" Jul 09 13:56:08.464971 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.464955 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.465649 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.465631 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.466041 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.466024 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 13:56:08.466974 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.466853 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.467097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.466943 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-668gb\"" Jul 09 13:56:08.469768 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.469748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.472044 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.472025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.472724 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.472705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.472864 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.472843 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.473036 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.472771 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9m2cr\"" Jul 09 13:56:08.473490 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.473464 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.474812 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-kubernetes\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.474919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysctl-d\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.474919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b14f4d6-fa84-41b8-bc18-71efb3265c28-host-slash\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.474919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvdq7\" (UniqueName: \"kubernetes.io/projected/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-kube-api-access-bvdq7\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.474919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysconfig\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.474919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d1673cd-05fb-47a9-8e27-6d5edb1d669f-agent-certs\") pod \"konnectivity-agent-2rhl9\" (UID: \"7d1673cd-05fb-47a9-8e27-6d5edb1d669f\") " pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.474919 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-etc-selinux\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-sys\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjkbz\" (UniqueName: \"kubernetes.io/projected/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-kube-api-access-qjkbz\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.474986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c999078b-b4f6-45f5-b976-a893c69e9e5b-hosts-file\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d1673cd-05fb-47a9-8e27-6d5edb1d669f-konnectivity-ca\") pod \"konnectivity-agent-2rhl9\" (UID: \"7d1673cd-05fb-47a9-8e27-6d5edb1d669f\") " pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-var-lib-kubelet\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysctl-conf\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-systemd\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp4tn\" (UniqueName: \"kubernetes.io/projected/1b14f4d6-fa84-41b8-bc18-71efb3265c28-kube-api-access-tp4tn\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-device-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-sys-fs\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-host\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c999078b-b4f6-45f5-b976-a893c69e9e5b-tmp-dir\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b14f4d6-fa84-41b8-bc18-71efb3265c28-iptables-alerter-script\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.475275 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-modprobe-d\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-run\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-tuned\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-socket-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4l7d\" (UniqueName: \"kubernetes.io/projected/c999078b-b4f6-45f5-b976-a893c69e9e5b-kube-api-access-c4l7d\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-registration-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-lib-modules\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-tmp\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.475877 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.475819 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:08.476378 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.475913 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.476378 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.476120 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 13:56:08.476378 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.476312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 13:56:08.477056 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.477038 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kcnns\"" Jul 09 13:56:08.477279 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.477263 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.477449 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.477433 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 13:56:08.477671 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.477655 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kft7q\"" Jul 09 13:56:08.477909 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.477893 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.478094 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.478072 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.478395 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.478379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.479192 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.479172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.480779 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.480757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:08.480889 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.480850 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:08.480889 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.480762 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 13:56:08.481625 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.481596 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 13:56:08.481738 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.481602 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 13:56:08.481738 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.481607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 13:56:08.482835 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.482809 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 13:56:08.482925 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.482875 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wsnjp\"" Jul 09 13:56:08.483507 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.483486 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 13:56:08.483507 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.483487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hhq9q\"" Jul 09 13:56:08.483788 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.483765 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 13:56:08.484373 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.484351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 13:56:08.497277 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.496230 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:56:08.514485 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.514460 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s7pjd" Jul 09 13:56:08.525103 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.525081 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s7pjd" Jul 09 13:56:08.565874 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.565841 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 13:56:08.576270 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/420baefd-d8f3-4345-8d7e-67a8ee6a9478-cni-binary-copy\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.576406 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-cni-multus\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.576406 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-systemd\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576406 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-etc-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576406 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576406 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-env-overrides\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576406 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fjpv\" (UniqueName: \"kubernetes.io/projected/4606e9b2-a291-45b6-8e37-0ac063c60b32-kube-api-access-9fjpv\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-node-log\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovnkube-script-lib\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-os-release\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576561 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-var-lib-kubelet\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdjkg\" (UniqueName: \"kubernetes.io/projected/3ec132f3-35d0-4fe6-b288-155949da7001-kube-api-access-vdjkg\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576716 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-var-lib-kubelet\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.576761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-hostroot\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-conf-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysctl-conf\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp4tn\" (UniqueName: \"kubernetes.io/projected/1b14f4d6-fa84-41b8-bc18-71efb3265c28-kube-api-access-tp4tn\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-cni-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-run-ovn-kubernetes\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c999078b-b4f6-45f5-b976-a893c69e9e5b-tmp-dir\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b14f4d6-fa84-41b8-bc18-71efb3265c28-iptables-alerter-script\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576967 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysctl-conf\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.576985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-run\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-system-cni-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovnkube-config\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-system-cni-dir\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49015798-f028-4b8e-a453-42dd0514db68-kubelet-config\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-var-lib-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577145 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-run\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-cni-netd\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.577326 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-registration-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq45j\" (UniqueName: \"kubernetes.io/projected/c9251f67-ef1b-4da7-a2fa-43b7531247b2-kube-api-access-tq45j\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-kubernetes\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-registration-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysctl-d\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c999078b-b4f6-45f5-b976-a893c69e9e5b-tmp-dir\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-kubernetes\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b14f4d6-fa84-41b8-bc18-71efb3265c28-host-slash\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysconfig\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysctl-d\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-ovn\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-sysconfig\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b14f4d6-fa84-41b8-bc18-71efb3265c28-host-slash\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d1673cd-05fb-47a9-8e27-6d5edb1d669f-agent-certs\") pod \"konnectivity-agent-2rhl9\" (UID: \"7d1673cd-05fb-47a9-8e27-6d5edb1d669f\") " pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-etc-selinux\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-sys\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.578225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjkbz\" (UniqueName: \"kubernetes.io/projected/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-kube-api-access-qjkbz\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-kubelet\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg6qr\" (UniqueName: \"kubernetes.io/projected/420baefd-d8f3-4345-8d7e-67a8ee6a9478-kube-api-access-pg6qr\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-etc-selinux\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-sys\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c999078b-b4f6-45f5-b976-a893c69e9e5b-hosts-file\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d1673cd-05fb-47a9-8e27-6d5edb1d669f-konnectivity-ca\") pod \"konnectivity-agent-2rhl9\" (UID: \"7d1673cd-05fb-47a9-8e27-6d5edb1d669f\") " pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577928 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c999078b-b4f6-45f5-b976-a893c69e9e5b-hosts-file\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.577991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-k8s-cni-cncf-io\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-serviceca\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-multus-certs\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-etc-kubernetes\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-kubelet\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cnibin\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.579097 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-systemd\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-device-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-sys-fs\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-host\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-systemd\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-cni-bin\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578287 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b14f4d6-fa84-41b8-bc18-71efb3265c28-iptables-alerter-script\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-slash\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-host\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578321 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-device-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-modprobe-d\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-tuned\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-socket-dir-parent\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578419 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-sys-fs\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578448 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d1673cd-05fb-47a9-8e27-6d5edb1d669f-konnectivity-ca\") pod \"konnectivity-agent-2rhl9\" (UID: \"7d1673cd-05fb-47a9-8e27-6d5edb1d669f\") " pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-host\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.579754 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-socket-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578523 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-modprobe-d\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-netns\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-socket-dir\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovn-node-metrics-cert\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4l7d\" (UniqueName: \"kubernetes.io/projected/c999078b-b4f6-45f5-b976-a893c69e9e5b-kube-api-access-c4l7d\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-lib-modules\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-tmp\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-os-release\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-log-socket\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-lib-modules\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-cni-bin\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvdq7\" (UniqueName: \"kubernetes.io/projected/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-kube-api-access-bvdq7\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-daemon-config\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.578980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwctf\" (UniqueName: \"kubernetes.io/projected/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-kube-api-access-zwctf\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.580313 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.579002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49015798-f028-4b8e-a453-42dd0514db68-dbus\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.580879 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.579025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-systemd-units\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.580879 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.579045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-run-netns\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.580879 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.579068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-cnibin\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.581747 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.581718 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-etc-tuned\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.581830 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.581767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-tmp\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.581933 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.581915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d1673cd-05fb-47a9-8e27-6d5edb1d669f-agent-certs\") pod \"konnectivity-agent-2rhl9\" (UID: \"7d1673cd-05fb-47a9-8e27-6d5edb1d669f\") " pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.592889 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.592865 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:08.592889 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.592894 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:08.593098 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.592918 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:08.593098 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.593027 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:56:09.093005984 +0000 UTC m=+3.037613730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:08.595861 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.595834 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvdq7\" (UniqueName: \"kubernetes.io/projected/e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1-kube-api-access-bvdq7\") pod \"aws-ebs-csi-driver-node-54fdq\" (UID: \"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.595960 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.595893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjkbz\" (UniqueName: \"kubernetes.io/projected/7c7d78ac-7694-490f-9f27-1293c3cd8bbd-kube-api-access-qjkbz\") pod \"tuned-rbgrj\" (UID: \"7c7d78ac-7694-490f-9f27-1293c3cd8bbd\") " pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.596011 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.595995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp4tn\" (UniqueName: \"kubernetes.io/projected/1b14f4d6-fa84-41b8-bc18-71efb3265c28-kube-api-access-tp4tn\") pod \"iptables-alerter-8rpmx\" (UID: \"1b14f4d6-fa84-41b8-bc18-71efb3265c28\") " pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.596127 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.596111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4l7d\" (UniqueName: \"kubernetes.io/projected/c999078b-b4f6-45f5-b976-a893c69e9e5b-kube-api-access-c4l7d\") pod \"node-resolver-gslzq\" (UID: \"c999078b-b4f6-45f5-b976-a893c69e9e5b\") " pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.648060 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.648003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"3bd818ee0caf1d1922453acfe179c146","Type":"ContainerStarted","Data":"0f6286155ae558197db05d9a70a4d79d064a2f5de35f24f1978df83a12abe534"} Jul 09 13:56:08.649132 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.649108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" event={"ID":"34d1f1a8876ffc091a8781eb04b08c52","Type":"ContainerStarted","Data":"3f9d1a510d228bfa04a980761c1d6974a0cea7d56962625f2d1da314728035b3"} Jul 09 13:56:08.680418 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq45j\" (UniqueName: \"kubernetes.io/projected/c9251f67-ef1b-4da7-a2fa-43b7531247b2-kube-api-access-tq45j\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.680418 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-ovn\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-kubelet\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg6qr\" (UniqueName: \"kubernetes.io/projected/420baefd-d8f3-4345-8d7e-67a8ee6a9478-kube-api-access-pg6qr\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-kubelet\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-ovn\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.680630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-k8s-cni-cncf-io\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-serviceca\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-multus-certs\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-etc-kubernetes\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.680734 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-kubelet\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-k8s-cni-cncf-io\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-multus-certs\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cnibin\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680814 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cnibin\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.680827 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:09.180812117 +0000 UTC m=+3.125419845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-cni-bin\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-cni-bin\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-etc-kubernetes\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-slash\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-kubelet\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681037 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.680910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-slash\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-socket-dir-parent\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-host\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-host\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681132 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-socket-dir-parent\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-netns\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovn-node-metrics-cert\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-os-release\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-run-netns\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-log-socket\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-cni-bin\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.681428 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-serviceca\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:08.681519 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:09.181500182 +0000 UTC m=+3.126107931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:08.681910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681448 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-daemon-config\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwctf\" (UniqueName: \"kubernetes.io/projected/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-kube-api-access-zwctf\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-log-socket\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49015798-f028-4b8e-a453-42dd0514db68-dbus\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-systemd-units\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-run-netns\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-cnibin\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/420baefd-d8f3-4345-8d7e-67a8ee6a9478-cni-binary-copy\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-cni-multus\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-systemd\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-etc-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-env-overrides\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fjpv\" (UniqueName: \"kubernetes.io/projected/4606e9b2-a291-45b6-8e37-0ac063c60b32-kube-api-access-9fjpv\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-node-log\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681953 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovnkube-script-lib\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.682796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.681982 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-os-release\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdjkg\" (UniqueName: \"kubernetes.io/projected/3ec132f3-35d0-4fe6-b288-155949da7001-kube-api-access-vdjkg\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682101 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-hostroot\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-conf-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682152 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-daemon-config\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-cni-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-os-release\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-run-ovn-kubernetes\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-cni-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-system-cni-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-cnibin\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovnkube-config\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-os-release\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-system-cni-dir\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49015798-f028-4b8e-a453-42dd0514db68-kubelet-config\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.683614 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-var-lib-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-cni-netd\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-multus-conf-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49015798-f028-4b8e-a453-42dd0514db68-dbus\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682619 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-systemd-units\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-hostroot\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-cni-bin\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-systemd\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682221 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-run-netns\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/420baefd-d8f3-4345-8d7e-67a8ee6a9478-cni-binary-copy\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9251f67-ef1b-4da7-a2fa-43b7531247b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.682971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-run-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-system-cni-dir\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683083 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-node-log\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683130 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-run-ovn-kubernetes\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9251f67-ef1b-4da7-a2fa-43b7531247b2-system-cni-dir\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-host-cni-netd\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.684304 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-env-overrides\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.685040 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/420baefd-d8f3-4345-8d7e-67a8ee6a9478-host-var-lib-cni-multus\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.685040 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-var-lib-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.685040 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4606e9b2-a291-45b6-8e37-0ac063c60b32-etc-openvswitch\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.685040 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683292 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49015798-f028-4b8e-a453-42dd0514db68-kubelet-config\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:08.685040 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovnkube-script-lib\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.685040 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.683423 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovnkube-config\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.687564 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.687537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4606e9b2-a291-45b6-8e37-0ac063c60b32-ovn-node-metrics-cert\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.694055 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.694012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg6qr\" (UniqueName: \"kubernetes.io/projected/420baefd-d8f3-4345-8d7e-67a8ee6a9478-kube-api-access-pg6qr\") pod \"multus-8w6bd\" (UID: \"420baefd-d8f3-4345-8d7e-67a8ee6a9478\") " pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.694539 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.694284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq45j\" (UniqueName: \"kubernetes.io/projected/c9251f67-ef1b-4da7-a2fa-43b7531247b2-kube-api-access-tq45j\") pod \"multus-additional-cni-plugins-85gcq\" (UID: \"c9251f67-ef1b-4da7-a2fa-43b7531247b2\") " pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.695601 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.695576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwctf\" (UniqueName: \"kubernetes.io/projected/ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba-kube-api-access-zwctf\") pod \"node-ca-xqhnt\" (UID: \"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba\") " pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.696410 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.696391 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fjpv\" (UniqueName: \"kubernetes.io/projected/4606e9b2-a291-45b6-8e37-0ac063c60b32-kube-api-access-9fjpv\") pod \"ovnkube-node-wr6gb\" (UID: \"4606e9b2-a291-45b6-8e37-0ac063c60b32\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.697204 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.697179 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdjkg\" (UniqueName: \"kubernetes.io/projected/3ec132f3-35d0-4fe6-b288-155949da7001-kube-api-access-vdjkg\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:08.770811 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.770767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gslzq" Jul 09 13:56:08.780566 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.780544 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:08.781001 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:08.780968 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc999078b_b4f6_45f5_b976_a893c69e9e5b.slice/crio-91aaf91bf2cf3ca12a5c5deb317875c1b07efb6c5e2f81be998befbbbed771a8 WatchSource:0}: Error finding container 91aaf91bf2cf3ca12a5c5deb317875c1b07efb6c5e2f81be998befbbbed771a8: Status 404 returned error can't find the container with id 91aaf91bf2cf3ca12a5c5deb317875c1b07efb6c5e2f81be998befbbbed771a8 Jul 09 13:56:08.789325 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.789300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rpmx" Jul 09 13:56:08.794175 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.794156 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" Jul 09 13:56:08.801228 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.801200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" Jul 09 13:56:08.803911 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:08.803881 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b14f4d6_fa84_41b8_bc18_71efb3265c28.slice/crio-842150af397a6b65b7c00067519ae686ab2d574ae23323a1dec5ed099657c463 WatchSource:0}: Error finding container 842150af397a6b65b7c00067519ae686ab2d574ae23323a1dec5ed099657c463: Status 404 returned error can't find the container with id 842150af397a6b65b7c00067519ae686ab2d574ae23323a1dec5ed099657c463 Jul 09 13:56:08.808032 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.808007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8w6bd" Jul 09 13:56:08.810221 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:08.810192 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c8dde0_bee4_4ee6_aaa3_cd3362a72ae1.slice/crio-309ab20fd9808a4c09e58c541cfa33d6fa5c18b2b64417e510eb8bed0a36016c WatchSource:0}: Error finding container 309ab20fd9808a4c09e58c541cfa33d6fa5c18b2b64417e510eb8bed0a36016c: Status 404 returned error can't find the container with id 309ab20fd9808a4c09e58c541cfa33d6fa5c18b2b64417e510eb8bed0a36016c Jul 09 13:56:08.816907 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.816726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqhnt" Jul 09 13:56:08.818874 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:08.818852 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7d78ac_7694_490f_9f27_1293c3cd8bbd.slice/crio-2193e2de297cc60e8ed21b7a1ea1bee8767b7576358a3fc8ea9bd0b38568df33 WatchSource:0}: Error finding container 2193e2de297cc60e8ed21b7a1ea1bee8767b7576358a3fc8ea9bd0b38568df33: Status 404 returned error can't find the container with id 2193e2de297cc60e8ed21b7a1ea1bee8767b7576358a3fc8ea9bd0b38568df33 Jul 09 13:56:08.822412 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.822391 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:08.828639 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:08.828479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85gcq" Jul 09 13:56:08.829248 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:08.829224 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420baefd_d8f3_4345_8d7e_67a8ee6a9478.slice/crio-1141941d5a095098b461275f8f5a49fa2af03b01058db836e0362c9ab33e4df9 WatchSource:0}: Error finding container 1141941d5a095098b461275f8f5a49fa2af03b01058db836e0362c9ab33e4df9: Status 404 returned error can't find the container with id 1141941d5a095098b461275f8f5a49fa2af03b01058db836e0362c9ab33e4df9 Jul 09 13:56:09.187072 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.186963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:09.187072 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.187035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:09.187072 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.187063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187144 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187182 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187210 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187224 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:10.187202469 +0000 UTC m=+4.131810197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187229 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187245 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187249 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:10.187236685 +0000 UTC m=+4.131844410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:09.187369 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.187287 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:56:10.187270622 +0000 UTC m=+4.131878366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:09.255331 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.255303 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:56:09.527943 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.527605 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:51:08 +0000 UTC" deadline="2027-12-11 15:33:32.716301916 +0000 UTC" Jul 09 13:56:09.527943 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.527878 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12481h37m23.188430631s" Jul 09 13:56:09.645833 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.645797 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:09.646016 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.645962 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:09.646459 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.646410 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:09.646583 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:09.646538 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:09.655918 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.655823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerStarted","Data":"731558c3423ed12e402d437c7bc9e7625898e93a4615fbde8c2721b00d2238d7"} Jul 09 13:56:09.657545 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.657512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" event={"ID":"7c7d78ac-7694-490f-9f27-1293c3cd8bbd","Type":"ContainerStarted","Data":"2193e2de297cc60e8ed21b7a1ea1bee8767b7576358a3fc8ea9bd0b38568df33"} Jul 09 13:56:09.660991 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.660959 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" event={"ID":"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1","Type":"ContainerStarted","Data":"309ab20fd9808a4c09e58c541cfa33d6fa5c18b2b64417e510eb8bed0a36016c"} Jul 09 13:56:09.663934 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.663906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rpmx" event={"ID":"1b14f4d6-fa84-41b8-bc18-71efb3265c28","Type":"ContainerStarted","Data":"842150af397a6b65b7c00067519ae686ab2d574ae23323a1dec5ed099657c463"} Jul 09 13:56:09.665808 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.665778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2rhl9" event={"ID":"7d1673cd-05fb-47a9-8e27-6d5edb1d669f","Type":"ContainerStarted","Data":"0db1d8959b19d30bb536ba06945df47e86f9b62ced7d8292c5483ad9d5c49a28"} Jul 09 13:56:09.667597 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.667571 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gslzq" event={"ID":"c999078b-b4f6-45f5-b976-a893c69e9e5b","Type":"ContainerStarted","Data":"91aaf91bf2cf3ca12a5c5deb317875c1b07efb6c5e2f81be998befbbbed771a8"} Jul 09 13:56:09.669267 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.669220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqhnt" event={"ID":"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba","Type":"ContainerStarted","Data":"0512ad55c5f3748ac41e92bb32552f534097d1610a21c5146d8c09e4655041fd"} Jul 09 13:56:09.673861 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.673742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"bec72e6e8a246511f1474a3d4c12dd32f9983fe7452a357d02c342d708915da3"} Jul 09 13:56:09.676330 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:09.676259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8w6bd" event={"ID":"420baefd-d8f3-4345-8d7e-67a8ee6a9478","Type":"ContainerStarted","Data":"1141941d5a095098b461275f8f5a49fa2af03b01058db836e0362c9ab33e4df9"} Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:10.195662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:10.195721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:10.195753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.195923 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196001 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:12.19597101 +0000 UTC m=+6.140578753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196388 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196441 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:12.19642533 +0000 UTC m=+6.141033074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196539 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196561 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196575 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:10.196671 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.196628 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:56:12.196613309 +0000 UTC m=+6.141221040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:10.528986 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:10.528884 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:51:08 +0000 UTC" deadline="2028-01-21 10:45:55.588187499 +0000 UTC" Jul 09 13:56:10.528986 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:10.528932 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13460h49m45.059261504s" Jul 09 13:56:10.640628 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:10.640595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:10.646542 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:10.646494 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:11.640113 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:11.640075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:11.640648 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:11.640250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:11.640722 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:11.640687 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:11.640834 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:11.640779 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:12.218867 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:12.218819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:12.219060 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:12.218892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:12.219060 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:12.218931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:12.219195 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219082 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:12.219195 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219149 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:16.219128815 +0000 UTC m=+10.163736560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:12.219623 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219599 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:12.219739 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219665 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:16.219646313 +0000 UTC m=+10.164254040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:12.219803 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219768 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:12.219803 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219784 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:12.219803 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219797 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:12.220005 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.219833 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:56:16.219821819 +0000 UTC m=+10.164429559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:12.643603 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:12.642944 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:12.643603 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:12.643086 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:13.640890 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:13.640271 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:13.640890 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:13.640418 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:13.640890 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:13.640776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:13.640890 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:13.640858 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:14.643492 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:14.642944 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:14.643492 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:14.643059 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:15.640334 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:15.640299 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:15.640516 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:15.640346 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:15.640516 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:15.640429 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:15.640648 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:15.640569 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:16.258728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:16.258791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:16.258823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.258935 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.258994 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:24.258974242 +0000 UTC m=+18.203581989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.259373 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.259419 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:24.25940445 +0000 UTC m=+18.204012178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.259517 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.259533 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.259545 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:16.259628 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.259579 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:56:24.259567991 +0000 UTC m=+18.204175724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:16.641728 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:16.641637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:16.641907 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:16.641750 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:17.640750 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:17.640709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:17.641179 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:17.640840 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:17.641179 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:17.641159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:17.641283 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:17.641234 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:18.641352 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:18.640904 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:18.641352 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:18.641041 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:19.640010 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:19.639970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:19.640197 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:19.640101 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:19.640496 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:19.640478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:19.640591 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:19.640565 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:20.640220 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:20.640178 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:20.640683 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:20.640321 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:21.640471 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:21.639923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:21.640471 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:21.640056 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:21.640471 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:21.639923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:21.640471 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:21.640302 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:22.640535 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:22.640501 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:22.640932 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:22.640608 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:23.640783 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:23.640748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:23.641276 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:23.640750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:23.641276 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:23.640856 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:23.641276 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:23.640981 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:24.315673 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:24.315635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:24.315673 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:24.315684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:24.315705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315789 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315788 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315800 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315825 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315834 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315847 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:40.315832291 +0000 UTC m=+34.260440015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315866 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:40.315856786 +0000 UTC m=+34.260464512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:24.315888 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.315888 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:56:40.315879152 +0000 UTC m=+34.260486877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:24.640594 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:24.640512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:24.640766 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:24.640628 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:25.640308 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:25.640271 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:25.640308 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:25.640298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:25.640835 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:25.640390 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:25.640835 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:25.640544 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:26.641528 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:26.641495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:26.641990 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:26.641610 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:27.640655 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:27.640622 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:27.640849 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:27.640733 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:27.640849 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:27.640774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:27.640952 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:27.640860 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:28.640700 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:28.640655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:28.641232 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:28.640781 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:29.640299 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.640097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:29.640497 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.640328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:29.640497 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:29.640421 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:29.640609 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:29.640525 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:29.723520 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.723488 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" event={"ID":"34d1f1a8876ffc091a8781eb04b08c52","Type":"ContainerStarted","Data":"aadea57af689ee98b6e7a00448207c7a64b9c1e95f95a42be8da62ce4b9b37fd"} Jul 09 13:56:29.725323 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.725298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" event={"ID":"7c7d78ac-7694-490f-9f27-1293c3cd8bbd","Type":"ContainerStarted","Data":"e93e940e4ee1cf9267b0d591859cf41164b7d5464e71c4381268cbce7177d236"} Jul 09 13:56:29.728271 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.727985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"2dbf03e8cecf3d938af181986dcfc87533aa728a253668898f8b0db666ea5bfd"} Jul 09 13:56:29.728271 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.728075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"c8216be0e0211e651b01dc16b2e927ba5092b6bacd8b50c307fa857300263ead"} Jul 09 13:56:29.728271 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.728122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"2513f66e500c8034abc49ad9f9ca27009a437e5cf98ec247a5789d7b10319ef6"} Jul 09 13:56:29.728271 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.728170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"fddafc66e5795a75b33220d15204c63575e141db186d9abc22bca5a84e429ace"} Jul 09 13:56:29.728271 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.728218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"ace7be1d9804e44489bd231aa80acd7d109224fec4ad50be69e7b19326877e20"} Jul 09 13:56:29.729420 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.729398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8w6bd" event={"ID":"420baefd-d8f3-4345-8d7e-67a8ee6a9478","Type":"ContainerStarted","Data":"03f11acfd2358e6bcf6e55c124c4fc54fac0fded7b1dd76951d19ec47b44cc81"} Jul 09 13:56:29.759909 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.759857 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" podStartSLOduration=21.759835375 podStartE2EDuration="21.759835375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:29.743592352 +0000 UTC m=+23.688200097" watchObservedRunningTime="2026-07-09 13:56:29.759835375 +0000 UTC m=+23.704443120" Jul 09 13:56:29.760243 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.760210 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8w6bd" podStartSLOduration=2.777505676 podStartE2EDuration="22.760199922s" totalImagesPullingTime="19.982694246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:29.759516939 +0000 UTC m=+23.704124683" watchObservedRunningTime="2026-07-09 13:56:29.760199922 +0000 UTC m=+23.704807668" Jul 09 13:56:29.778548 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:29.778196 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rbgrj" podStartSLOduration=2.852042043 podStartE2EDuration="22.778175371s" totalImagesPullingTime="19.926133328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:29.77752897 +0000 UTC m=+23.722136716" watchObservedRunningTime="2026-07-09 13:56:29.778175371 +0000 UTC m=+23.722783121" Jul 09 13:56:30.640885 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.640664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:30.641102 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:30.640978 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:30.733249 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.733214 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9251f67-ef1b-4da7-a2fa-43b7531247b2" containerID="8e70f262d59aacf535f50c67e3ffe0bb1b1c8f3d373abd52bef54b2b3807cfd1" exitCode=0 Jul 09 13:56:30.733713 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.733310 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerDied","Data":"8e70f262d59aacf535f50c67e3ffe0bb1b1c8f3d373abd52bef54b2b3807cfd1"} Jul 09 13:56:30.737296 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.737273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" event={"ID":"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1","Type":"ContainerStarted","Data":"b1420a8d9ed4ad56be44a26b1604fff5c50292fc6ca8e925771f5426d9535133"} Jul 09 13:56:30.738771 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.738745 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rpmx" event={"ID":"1b14f4d6-fa84-41b8-bc18-71efb3265c28","Type":"ContainerStarted","Data":"f8042beb447199d5c59f37ebbe72d04e3b13910f931a384a4d8ad814a0b0907c"} Jul 09 13:56:30.740077 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.740056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2rhl9" event={"ID":"7d1673cd-05fb-47a9-8e27-6d5edb1d669f","Type":"ContainerStarted","Data":"8f3ed337339bce9997af458a0c50490dee8f064538be557ab9c4a40e24a7d380"} Jul 09 13:56:30.741291 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.741274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gslzq" event={"ID":"c999078b-b4f6-45f5-b976-a893c69e9e5b","Type":"ContainerStarted","Data":"5fa35352217e11d91570d21a623a2550907a5d8ac6e26eaf8af4f635f006fa7d"} Jul 09 13:56:30.742705 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.742685 2559 generic.go:356] "Generic (PLEG): container finished" podID="3bd818ee0caf1d1922453acfe179c146" containerID="b8161ea090aef3f779ee3cd16506e444da1027752a9f2fb72c9e9caf8effd742" exitCode=0 Jul 09 13:56:30.742777 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.742750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"3bd818ee0caf1d1922453acfe179c146","Type":"ContainerDied","Data":"b8161ea090aef3f779ee3cd16506e444da1027752a9f2fb72c9e9caf8effd742"} Jul 09 13:56:30.744153 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.744135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqhnt" event={"ID":"ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba","Type":"ContainerStarted","Data":"0d1f58e28f3b9bdaeab25ecf2a9843ca3feb997348e9fd6f9b4863992248f960"} Jul 09 13:56:30.746824 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.746802 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"34225bdd7d0b679ccbb449a41653853211b46707ca10cbfd8161783f5154ea9b"} Jul 09 13:56:30.840713 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.840661 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gslzq" podStartSLOduration=3.8418197469999997 podStartE2EDuration="23.840640789s" totalImagesPullingTime="19.998821042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:30.840015649 +0000 UTC m=+24.784623477" watchObservedRunningTime="2026-07-09 13:56:30.840640789 +0000 UTC m=+24.785248534" Jul 09 13:56:30.857168 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.857128 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqhnt" podStartSLOduration=3.92547513 podStartE2EDuration="23.857114086s" totalImagesPullingTime="19.931638956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:30.856768232 +0000 UTC m=+24.801375978" watchObservedRunningTime="2026-07-09 13:56:30.857114086 +0000 UTC m=+24.801721847" Jul 09 13:56:30.887118 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.887018 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2rhl9" podStartSLOduration=8.430163498 podStartE2EDuration="23.886998182s" totalImagesPullingTime="15.456834684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:30.872498752 +0000 UTC m=+24.817106495" watchObservedRunningTime="2026-07-09 13:56:30.886998182 +0000 UTC m=+24.831605928" Jul 09 13:56:30.887579 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:30.887548 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8rpmx" podStartSLOduration=8.441991317 podStartE2EDuration="23.88753945s" totalImagesPullingTime="15.445548133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:30.887103926 +0000 UTC m=+24.831711671" watchObservedRunningTime="2026-07-09 13:56:30.88753945 +0000 UTC m=+24.832147198" Jul 09 13:56:31.036291 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.036264 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:31.036740 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.036720 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:31.042216 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.042183 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:31.101731 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.101712 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 13:56:31.119795 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.119759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:31.207481 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.207431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:31.310844 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.310750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:31.548997 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.548889 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:56:31.101727485Z","UUID":"baf0538a-f284-45ed-acb9-85b3b8bda4d4","Handler":null,"Name":"","Endpoint":""} Jul 09 13:56:31.550674 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.550647 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 13:56:31.550807 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.550702 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 13:56:31.640684 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.640605 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:31.640684 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.640644 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:31.640898 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:31.640729 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:31.640955 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:31.640898 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:31.752384 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.752340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" event={"ID":"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1","Type":"ContainerStarted","Data":"8bcb27979c8815d3f29c06b4395e7cb0e6cbd52e69f9092584c20c119e87561f"} Jul 09 13:56:31.755586 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.755557 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"3bd818ee0caf1d1922453acfe179c146","Type":"ContainerStarted","Data":"5995a2f8e16651fe71bf34beda6d290a2e519fafa3ec256cd2ee88209aa60069"} Jul 09 13:56:31.772385 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:31.772332 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" podStartSLOduration=23.77231923 podStartE2EDuration="23.77231923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:31.77180933 +0000 UTC m=+25.716417080" watchObservedRunningTime="2026-07-09 13:56:31.77231923 +0000 UTC m=+25.716926976" Jul 09 13:56:32.640632 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:32.640553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:32.640777 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:32.640681 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:32.760298 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:32.760258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" event={"ID":"e5c8dde0-bee4-4ee6-aaa3-cd3362a72ae1","Type":"ContainerStarted","Data":"094e64cab98c53f050481c08d28bbaef5377b03b1bb2e87c97edba0ad1c2b62b"} Jul 09 13:56:32.764285 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:32.764255 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 13:56:32.764412 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:32.764293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"1638020ed668df9e4f1b1bb330b7df3a2a8a1e4617da1007d48ef58943a01de4"} Jul 09 13:56:32.780900 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:32.780856 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54fdq" podStartSLOduration=3.498886672 podStartE2EDuration="25.780841989s" totalImagesPullingTime="22.281955317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:32.780521166 +0000 UTC m=+26.725128912" watchObservedRunningTime="2026-07-09 13:56:32.780841989 +0000 UTC m=+26.725449734" Jul 09 13:56:33.152946 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:33.152909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:33.253937 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:33.253900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:33.640578 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:33.640496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:33.640732 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:33.640605 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:33.640732 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:33.640510 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:33.640732 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:33.640694 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:34.640484 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.640392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:34.641161 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:34.640559 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:34.769237 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.769210 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:34.769414 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.769337 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 13:56:34.769993 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.769972 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2rhl9" Jul 09 13:56:34.773432 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.773393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" event={"ID":"4606e9b2-a291-45b6-8e37-0ac063c60b32","Type":"ContainerStarted","Data":"1ba849b12e56588c605e19b383984e338f30c568842c4644b4b46dd4d87f91ad"} Jul 09 13:56:34.773624 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.773601 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:34.773735 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.773678 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:34.773735 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.773724 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:34.791021 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.790992 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:34.792649 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.792629 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:56:34.814435 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.814390 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" podStartSLOduration=7.49898174 podStartE2EDuration="27.81437319s" totalImagesPullingTime="20.31539145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:34.81372085 +0000 UTC m=+28.758328620" watchObservedRunningTime="2026-07-09 13:56:34.81437319 +0000 UTC m=+28.758980935" Jul 09 13:56:34.841474 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:34.841425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:35.640256 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:35.640223 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:35.640541 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:35.640227 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:35.640541 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:35.640337 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:35.640541 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:35.640488 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:36.145543 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.145373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:36.346248 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.346141 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6wrzb"] Jul 09 13:56:36.346400 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.346306 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:36.346491 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:36.346402 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:36.346770 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.346748 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zl2xb"] Jul 09 13:56:36.346861 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.346848 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:36.346964 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:36.346946 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:36.348397 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.348376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fq27s"] Jul 09 13:56:36.348489 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.348477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:36.348557 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:36.348542 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:36.779817 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.779726 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9251f67-ef1b-4da7-a2fa-43b7531247b2" containerID="8450ce5d2e8d30d337211ce11f8b350f62d24e26a9050d689bf36005fbc8dc70" exitCode=0 Jul 09 13:56:36.780263 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:36.779813 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerDied","Data":"8450ce5d2e8d30d337211ce11f8b350f62d24e26a9050d689bf36005fbc8dc70"} Jul 09 13:56:37.640656 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:37.640575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:37.640798 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:37.640675 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:37.783993 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:37.783956 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9251f67-ef1b-4da7-a2fa-43b7531247b2" containerID="35c28fb23af1292e833be727e4ae7644d493a50201c025a33ac6f4e060acc693" exitCode=0 Jul 09 13:56:37.784381 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:37.784012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerDied","Data":"35c28fb23af1292e833be727e4ae7644d493a50201c025a33ac6f4e060acc693"} Jul 09 13:56:38.640002 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:38.639927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:38.640130 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:38.640026 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:38.640130 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:38.640055 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:38.640130 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:38.640107 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:38.788869 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:38.788841 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9251f67-ef1b-4da7-a2fa-43b7531247b2" containerID="7f4204b39b1018a21880871a319ffb9698c5ce154a27ce215e4d3c0586c7e55a" exitCode=0 Jul 09 13:56:38.789263 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:38.788887 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerDied","Data":"7f4204b39b1018a21880871a319ffb9698c5ce154a27ce215e4d3c0586c7e55a"} Jul 09 13:56:39.640224 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:39.640017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:39.640402 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:39.640311 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:39.961910 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:39.961819 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:40.058689 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:40.058656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:40.335561 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:40.335521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:40.335744 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:40.335583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:40.335744 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335719 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:40.335744 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335733 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335762 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:40.335763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335777 2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7mdf for pod openshift-network-diagnostics/network-check-target-fq27s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335776 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret podName:49015798-f028-4b8e-a453-42dd0514db68 nodeName:}" failed. No retries permitted until 2026-07-09 13:57:12.335762287 +0000 UTC m=+66.280370012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret") pod "global-pull-secret-syncer-zl2xb" (UID: "49015798-f028-4b8e-a453-42dd0514db68") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335829 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335857 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf podName:b9bbec65-c029-4b13-ab49-5846f88e475a nodeName:}" failed. No retries permitted until 2026-07-09 13:57:12.335840066 +0000 UTC m=+66.280447793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7mdf" (UniqueName: "kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf") pod "network-check-target-fq27s" (UID: "b9bbec65-c029-4b13-ab49-5846f88e475a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:56:40.335920 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.335875 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:57:12.335865502 +0000 UTC m=+66.280473231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:56:40.640921 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:40.640838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:40.641088 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.640975 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:56:40.641088 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:40.640839 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:40.641088 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:40.641074 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl2xb" podUID="49015798-f028-4b8e-a453-42dd0514db68" Jul 09 13:56:41.640559 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.640524 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:41.640996 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:41.640654 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq27s" podUID="b9bbec65-c029-4b13-ab49-5846f88e475a" Jul 09 13:56:41.879323 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.879250 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeReady" Jul 09 13:56:41.879501 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.879428 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 13:56:41.940556 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.940518 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rffpl"] Jul 09 13:56:41.960940 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.960903 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ktr6t"] Jul 09 13:56:41.961884 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.961858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:41.965175 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.965150 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 13:56:41.965317 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.965212 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r54c2\"" Jul 09 13:56:41.965317 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.965152 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 13:56:41.965478 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.965425 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 13:56:41.975361 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.975335 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rffpl"] Jul 09 13:56:41.975361 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.975367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ktr6t"] Jul 09 13:56:41.975556 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.975478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:41.979381 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.979358 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dkvmm\"" Jul 09 13:56:41.979864 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.979847 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 13:56:41.980100 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:41.980084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 13:56:42.046741 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.046687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:42.051698 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.051669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99566bc4-d1c4-4c5c-8b6b-67fb5989faad-cert\") pod \"ingress-canary-rffpl\" (UID: \"99566bc4-d1c4-4c5c-8b6b-67fb5989faad\") " pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.051854 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.051771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bpd\" (UniqueName: \"kubernetes.io/projected/99566bc4-d1c4-4c5c-8b6b-67fb5989faad-kube-api-access-s8bpd\") pod \"ingress-canary-rffpl\" (UID: \"99566bc4-d1c4-4c5c-8b6b-67fb5989faad\") " pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.122458 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.122396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:42.152199 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.152121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5gb7\" (UniqueName: \"kubernetes.io/projected/9295001a-27e2-4430-b2e7-b3a1d900a1d1-kube-api-access-d5gb7\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.152199 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.152174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9295001a-27e2-4430-b2e7-b3a1d900a1d1-config-volume\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.152425 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.152236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bpd\" (UniqueName: \"kubernetes.io/projected/99566bc4-d1c4-4c5c-8b6b-67fb5989faad-kube-api-access-s8bpd\") pod \"ingress-canary-rffpl\" (UID: \"99566bc4-d1c4-4c5c-8b6b-67fb5989faad\") " pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.152425 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.152279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99566bc4-d1c4-4c5c-8b6b-67fb5989faad-cert\") pod \"ingress-canary-rffpl\" (UID: \"99566bc4-d1c4-4c5c-8b6b-67fb5989faad\") " pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.152425 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.152306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9295001a-27e2-4430-b2e7-b3a1d900a1d1-tmp-dir\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.152425 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.152353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.157459 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.157416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99566bc4-d1c4-4c5c-8b6b-67fb5989faad-cert\") pod \"ingress-canary-rffpl\" (UID: \"99566bc4-d1c4-4c5c-8b6b-67fb5989faad\") " pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.161599 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.161579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bpd\" (UniqueName: \"kubernetes.io/projected/99566bc4-d1c4-4c5c-8b6b-67fb5989faad-kube-api-access-s8bpd\") pod \"ingress-canary-rffpl\" (UID: \"99566bc4-d1c4-4c5c-8b6b-67fb5989faad\") " pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.253796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.253756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.254014 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.253812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5gb7\" (UniqueName: \"kubernetes.io/projected/9295001a-27e2-4430-b2e7-b3a1d900a1d1-kube-api-access-d5gb7\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.254014 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:42.253935 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:56:42.254014 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:42.254007 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:42.753986305 +0000 UTC m=+36.698594040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:56:42.254181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.254149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9295001a-27e2-4430-b2e7-b3a1d900a1d1-config-volume\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.254262 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.254245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9295001a-27e2-4430-b2e7-b3a1d900a1d1-tmp-dir\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.254609 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.254593 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9295001a-27e2-4430-b2e7-b3a1d900a1d1-tmp-dir\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.254864 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.254837 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9295001a-27e2-4430-b2e7-b3a1d900a1d1-config-volume\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.269649 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.269623 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5gb7\" (UniqueName: \"kubernetes.io/projected/9295001a-27e2-4430-b2e7-b3a1d900a1d1-kube-api-access-d5gb7\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.273435 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.273409 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rffpl" Jul 09 13:56:42.640225 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.640192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:56:42.640526 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.640385 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:56:42.643388 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.643366 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:56:42.643992 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.643426 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:56:42.643992 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.643501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qkthd\"" Jul 09 13:56:42.759310 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:42.759273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:42.759511 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:42.759432 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:56:42.759575 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:42.759524 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:43.759504928 +0000 UTC m=+37.704112672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:56:43.041552 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.041523 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rffpl"] Jul 09 13:56:43.090367 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:56:43.090339 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99566bc4_d1c4_4c5c_8b6b_67fb5989faad.slice/crio-3b50cadae1b5a6ef74b0e6aa8b6c0046cffd60e16d6c6849fa236d2ccb7c793a WatchSource:0}: Error finding container 3b50cadae1b5a6ef74b0e6aa8b6c0046cffd60e16d6c6849fa236d2ccb7c793a: Status 404 returned error can't find the container with id 3b50cadae1b5a6ef74b0e6aa8b6c0046cffd60e16d6c6849fa236d2ccb7c793a Jul 09 13:56:43.640504 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.640470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:56:43.643834 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.643811 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:56:43.644347 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.643811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkkhr\"" Jul 09 13:56:43.644766 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.644751 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:56:43.767795 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.767764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:43.767985 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:43.767905 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:56:43.767985 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:43.767978 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:45.767959819 +0000 UTC m=+39.712567546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:56:43.778771 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.778744 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:43.805953 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.805906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rffpl" event={"ID":"99566bc4-d1c4-4c5c-8b6b-67fb5989faad","Type":"ContainerStarted","Data":"3b50cadae1b5a6ef74b0e6aa8b6c0046cffd60e16d6c6849fa236d2ccb7c793a"} Jul 09 13:56:43.808986 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.808954 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9251f67-ef1b-4da7-a2fa-43b7531247b2" containerID="a168fec90413cc35c4babdead836e2aa434b1a7e54d619dd90f4ba0fa07e6b52" exitCode=0 Jul 09 13:56:43.809118 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.808998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerDied","Data":"a168fec90413cc35c4babdead836e2aa434b1a7e54d619dd90f4ba0fa07e6b52"} Jul 09 13:56:43.841349 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:43.841318 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:44.814947 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:44.814911 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9251f67-ef1b-4da7-a2fa-43b7531247b2" containerID="6f36abcd203af48b1ce91284bb734fbdc9b78a8254b231a336bacfeb11abb19d" exitCode=0 Jul 09 13:56:44.815343 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:44.814992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerDied","Data":"6f36abcd203af48b1ce91284bb734fbdc9b78a8254b231a336bacfeb11abb19d"} Jul 09 13:56:45.230322 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.230211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:45.307353 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.307313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:45.785226 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.785188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:45.785370 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:45.785305 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:56:45.785370 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:45.785357 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:49.785343657 +0000 UTC m=+43.729951383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:56:45.819190 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.819156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rffpl" event={"ID":"99566bc4-d1c4-4c5c-8b6b-67fb5989faad","Type":"ContainerStarted","Data":"fc0b673f8d92764dfd0a8c3af48f12295cae09aa38aaae34d1968ae69fd7c5ff"} Jul 09 13:56:45.822676 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.822643 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85gcq" event={"ID":"c9251f67-ef1b-4da7-a2fa-43b7531247b2","Type":"ContainerStarted","Data":"cdbdf67512b61006e118888ee8030f30e2b196ddaa7e34e73477585d8ced5be3"} Jul 09 13:56:45.835104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.835057 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rffpl" podStartSLOduration=2.320723368 podStartE2EDuration="4.835039997s" totalImagesPullingTime="2.514316629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:45.834679263 +0000 UTC m=+39.779287008" watchObservedRunningTime="2026-07-09 13:56:45.835039997 +0000 UTC m=+39.779647741" Jul 09 13:56:45.857064 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.857004 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-85gcq" podStartSLOduration=8.432519531 podStartE2EDuration="38.856983739s" totalImagesPullingTime="30.424464208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:45.855624325 +0000 UTC m=+39.800232071" watchObservedRunningTime="2026-07-09 13:56:45.856983739 +0000 UTC m=+39.801591485" Jul 09 13:56:45.978106 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:45.978026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:46.049560 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:46.049363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:47.481090 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:47.481054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:47.577627 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:47.577598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:48.832114 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:48.832055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:48.895095 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:48.895054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:56:49.813626 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:49.813585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:49.813839 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:49.813725 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:56:49.813839 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:49.813795 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:56:57.813776355 +0000 UTC m=+51.758384079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:56:57.871935 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:56:57.871893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:56:57.872334 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:57.872044 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:56:57.872334 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:56:57.872118 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:57:13.872101205 +0000 UTC m=+67.816708928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:57:00.927630 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.927596 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd"] Jul 09 13:57:00.929518 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.929496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:00.932140 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.932117 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 13:57:00.932257 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.932119 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 13:57:00.933138 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.933116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jgblf\"" Jul 09 13:57:00.933214 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.933177 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 13:57:00.933260 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.933247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 13:57:00.938705 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.938683 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd"] Jul 09 13:57:00.992652 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.992612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mzgx\" (UniqueName: \"kubernetes.io/projected/87453629-7412-4576-8e32-741ab487d026-kube-api-access-2mzgx\") pod \"managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd\" (UID: \"87453629-7412-4576-8e32-741ab487d026\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:00.992828 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:00.992672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87453629-7412-4576-8e32-741ab487d026-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd\" (UID: \"87453629-7412-4576-8e32-741ab487d026\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:01.093213 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.093172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mzgx\" (UniqueName: \"kubernetes.io/projected/87453629-7412-4576-8e32-741ab487d026-kube-api-access-2mzgx\") pod \"managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd\" (UID: \"87453629-7412-4576-8e32-741ab487d026\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:01.093393 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.093238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87453629-7412-4576-8e32-741ab487d026-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd\" (UID: \"87453629-7412-4576-8e32-741ab487d026\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:01.097688 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.097667 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87453629-7412-4576-8e32-741ab487d026-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd\" (UID: \"87453629-7412-4576-8e32-741ab487d026\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:01.102751 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.102726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mzgx\" (UniqueName: \"kubernetes.io/projected/87453629-7412-4576-8e32-741ab487d026-kube-api-access-2mzgx\") pod \"managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd\" (UID: \"87453629-7412-4576-8e32-741ab487d026\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:01.245367 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.245289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" Jul 09 13:57:01.371658 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.371627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd"] Jul 09 13:57:01.375005 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:57:01.374980 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87453629_7412_4576_8e32_741ab487d026.slice/crio-4e0044794734e6bd22f6bd109246c66fc9b7cbb4a2734cfd9df98308ce2fa847 WatchSource:0}: Error finding container 4e0044794734e6bd22f6bd109246c66fc9b7cbb4a2734cfd9df98308ce2fa847: Status 404 returned error can't find the container with id 4e0044794734e6bd22f6bd109246c66fc9b7cbb4a2734cfd9df98308ce2fa847 Jul 09 13:57:01.862394 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:01.862357 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" event={"ID":"87453629-7412-4576-8e32-741ab487d026","Type":"ContainerStarted","Data":"4e0044794734e6bd22f6bd109246c66fc9b7cbb4a2734cfd9df98308ce2fa847"} Jul 09 13:57:06.795460 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:06.795423 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr6gb" Jul 09 13:57:06.961767 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:06.961723 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:07.058299 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:07.058227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:08.193030 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:08.192996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:08.259433 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:08.259393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:08.339104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:08.339075 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:12.369549 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.369517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:57:12.369549 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.369553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:57:12.370012 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.369589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:57:12.373955 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.373929 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:57:12.374093 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.373969 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:57:12.374093 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.374027 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:57:12.380490 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:57:12.380475 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 13:57:12.380552 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:57:12.380542 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:16.380526307 +0000 UTC m=+130.325134034 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : secret "metrics-daemon-secret" not found Jul 09 13:57:12.383052 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.383028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49015798-f028-4b8e-a453-42dd0514db68-original-pull-secret\") pod \"global-pull-secret-syncer-zl2xb\" (UID: \"49015798-f028-4b8e-a453-42dd0514db68\") " pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:57:12.383181 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.383039 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:57:12.394227 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.394202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mdf\" (UniqueName: \"kubernetes.io/projected/b9bbec65-c029-4b13-ab49-5846f88e475a-kube-api-access-h7mdf\") pod \"network-check-target-fq27s\" (UID: \"b9bbec65-c029-4b13-ab49-5846f88e475a\") " pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:57:12.454607 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.454574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkkhr\"" Jul 09 13:57:12.462158 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.462136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:57:12.608128 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.608097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fq27s"] Jul 09 13:57:12.611328 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:57:12.611293 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bbec65_c029_4b13_ab49_5846f88e475a.slice/crio-29bb4bcd6ff095d4809c9813165f5259a213acff94ebd6964c16d3289ef02d8e WatchSource:0}: Error finding container 29bb4bcd6ff095d4809c9813165f5259a213acff94ebd6964c16d3289ef02d8e: Status 404 returned error can't find the container with id 29bb4bcd6ff095d4809c9813165f5259a213acff94ebd6964c16d3289ef02d8e Jul 09 13:57:12.651873 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.651792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl2xb" Jul 09 13:57:12.774950 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.774918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zl2xb"] Jul 09 13:57:12.778031 ip-10-0-136-155 kubenswrapper[2559]: W0709 13:57:12.778002 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49015798_f028_4b8e_a453_42dd0514db68.slice/crio-9d1c42a42d2fec97d761e0a90141cb5d5a89e017051cea4f038601a5c624ec83 WatchSource:0}: Error finding container 9d1c42a42d2fec97d761e0a90141cb5d5a89e017051cea4f038601a5c624ec83: Status 404 returned error can't find the container with id 9d1c42a42d2fec97d761e0a90141cb5d5a89e017051cea4f038601a5c624ec83 Jul 09 13:57:12.890478 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.890423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zl2xb" event={"ID":"49015798-f028-4b8e-a453-42dd0514db68","Type":"ContainerStarted","Data":"9d1c42a42d2fec97d761e0a90141cb5d5a89e017051cea4f038601a5c624ec83"} Jul 09 13:57:12.891517 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:12.891491 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fq27s" event={"ID":"b9bbec65-c029-4b13-ab49-5846f88e475a","Type":"ContainerStarted","Data":"29bb4bcd6ff095d4809c9813165f5259a213acff94ebd6964c16d3289ef02d8e"} Jul 09 13:57:13.881126 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:13.881025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:57:13.881635 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:57:13.881196 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:57:13.881635 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:57:13.881268 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:57:45.88124788 +0000 UTC m=+99.825855606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:57:13.896104 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:13.896067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" event={"ID":"87453629-7412-4576-8e32-741ab487d026","Type":"ContainerStarted","Data":"1ecb609dd63e50cfddba04f021c27be37c035a065a8b1dc6ad8302a9a51edfc9"} Jul 09 13:57:13.913335 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:13.913280 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" podStartSLOduration=1.919703961 podStartE2EDuration="13.913260241s" totalImagesPullingTime="11.99355628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:13.912891951 +0000 UTC m=+67.857499696" watchObservedRunningTime="2026-07-09 13:57:13.913260241 +0000 UTC m=+67.857867987" Jul 09 13:57:17.907886 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:17.907838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zl2xb" event={"ID":"49015798-f028-4b8e-a453-42dd0514db68","Type":"ContainerStarted","Data":"54521af297a179d417119233bbda388595cd2196b1dc82dadf21781e30c9e100"} Jul 09 13:57:17.909316 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:17.909293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fq27s" event={"ID":"b9bbec65-c029-4b13-ab49-5846f88e475a","Type":"ContainerStarted","Data":"edbd92004654df98cbcbddfcb7a551b4f50e49c762c772291d911b5359871b94"} Jul 09 13:57:17.909474 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:17.909411 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:57:17.922819 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:17.922765 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zl2xb" podStartSLOduration=65.970772304 podStartE2EDuration="1m10.922748426s" totalImagesPullingTime="4.951976122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:17.92260612 +0000 UTC m=+71.867213865" watchObservedRunningTime="2026-07-09 13:57:17.922748426 +0000 UTC m=+71.867356176" Jul 09 13:57:17.939182 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:17.939134 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fq27s" podStartSLOduration=65.822647221 podStartE2EDuration="1m10.939120654s" totalImagesPullingTime="5.116473433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:17.938405507 +0000 UTC m=+71.883013251" watchObservedRunningTime="2026-07-09 13:57:17.939120654 +0000 UTC m=+71.883728398" Jul 09 13:57:39.132426 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:39.132392 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:39.215823 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:39.215788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:57:45.903782 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:45.903737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:57:45.904363 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:57:45.903850 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:57:45.904363 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:57:45.903903 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:49.903888722 +0000 UTC m=+163.848496446 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:57:48.914796 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:57:48.914763 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fq27s" Jul 09 13:58:16.406633 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:58:16.406582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:58:16.407042 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:58:16.406741 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 13:58:16.407042 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:58:16.406821 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs podName:3ec132f3-35d0-4fe6-b288-155949da7001 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:18.406805062 +0000 UTC m=+252.351412785 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs") pod "network-metrics-daemon-6wrzb" (UID: "3ec132f3-35d0-4fe6-b288-155949da7001") : secret "metrics-daemon-secret" not found Jul 09 13:58:44.984707 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:58:44.984663 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ktr6t" podUID="9295001a-27e2-4430-b2e7-b3a1d900a1d1" Jul 09 13:58:45.657348 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:58:45.657311 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6wrzb" podUID="3ec132f3-35d0-4fe6-b288-155949da7001" Jul 09 13:58:49.937135 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:58:49.937096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 13:58:49.937546 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:58:49.937208 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:49.937546 ip-10-0-136-155 kubenswrapper[2559]: E0709 13:58:49.937274 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls podName:9295001a-27e2-4430-b2e7-b3a1d900a1d1 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:51.937258954 +0000 UTC m=+285.881866679 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls") pod "dns-default-ktr6t" (UID: "9295001a-27e2-4430-b2e7-b3a1d900a1d1") : secret "dns-default-metrics-tls" not found Jul 09 13:58:56.641761 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:58:56.641667 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 13:58:59.640498 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:58:59.640458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktr6t" Jul 09 13:59:06.062165 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:06.062130 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:11.280562 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:11.280518 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:14.195118 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:14.195090 2559 generic.go:356] "Generic (PLEG): container finished" podID="87453629-7412-4576-8e32-741ab487d026" containerID="1ecb609dd63e50cfddba04f021c27be37c035a065a8b1dc6ad8302a9a51edfc9" exitCode=255 Jul 09 13:59:14.195489 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:14.195165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" event={"ID":"87453629-7412-4576-8e32-741ab487d026","Type":"ContainerDied","Data":"1ecb609dd63e50cfddba04f021c27be37c035a065a8b1dc6ad8302a9a51edfc9"} Jul 09 13:59:14.200769 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:14.200748 2559 scope.go:117] "RemoveContainer" containerID="1ecb609dd63e50cfddba04f021c27be37c035a065a8b1dc6ad8302a9a51edfc9" Jul 09 13:59:15.198773 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:15.198732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65bf86fd7b-zcrpd" event={"ID":"87453629-7412-4576-8e32-741ab487d026","Type":"ContainerStarted","Data":"8a2288b53ad3bc6bf9b439b626b09004c283d34e2f7f6c55c1b9ca2ce98561e3"} Jul 09 13:59:32.209717 ip-10-0-136-155 kubenswrapper[2559]: I0709 13:59:32.209684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:00.402859 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.402786 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4nqmg"] Jul 09 14:00:00.404921 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.404905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.407292 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.407269 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:00:00.408426 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.408410 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 14:00:00.408534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.408412 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 14:00:00.408534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.408412 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q897h\"" Jul 09 14:00:00.412333 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.412315 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 14:00:00.420604 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.420585 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 14:00:00.432684 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.432657 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4nqmg"] Jul 09 14:00:00.490714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.490680 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs"] Jul 09 14:00:00.493167 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.493143 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2"] Jul 09 14:00:00.493309 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.493264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" Jul 09 14:00:00.495134 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.495118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:00.495885 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.495870 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rxhqt\"" Jul 09 14:00:00.497773 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.497753 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:00:00.497865 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.497790 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 14:00:00.497865 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.497842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 14:00:00.497968 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.497842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zgdmc\"" Jul 09 14:00:00.507164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.507144 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7649b6fdf6-6mg2t"] Jul 09 14:00:00.509405 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.509385 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4"] Jul 09 14:00:00.509522 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.509505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.511307 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.511286 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wkswv"] Jul 09 14:00:00.511432 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.511414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.513264 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.513247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs"] Jul 09 14:00:00.513346 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.513318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.517423 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.517287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34506a96-b741-46b1-b3ad-f15dbc4806e2-config\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.517630 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.517608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34506a96-b741-46b1-b3ad-f15dbc4806e2-serving-cert\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.518001 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.517804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34506a96-b741-46b1-b3ad-f15dbc4806e2-trusted-ca\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.518116 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.517959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvrld\" (UniqueName: \"kubernetes.io/projected/34506a96-b741-46b1-b3ad-f15dbc4806e2-kube-api-access-xvrld\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.518838 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.518809 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 14:00:00.519076 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.519052 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 14:00:00.520791 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.520717 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:00:00.521029 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.521006 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:00:00.521595 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.521575 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 14:00:00.522171 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.521903 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:00:00.522368 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522349 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:00:00.522600 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522578 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 14:00:00.522708 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6vcgt\"" Jul 09 14:00:00.522708 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522430 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tzz2q\"" Jul 09 14:00:00.522825 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522720 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:00:00.522825 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522749 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2"] Jul 09 14:00:00.522825 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522779 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-blxcx\"" Jul 09 14:00:00.522825 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.522666 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:00:00.523149 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.523132 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 14:00:00.525077 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.525056 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7649b6fdf6-6mg2t"] Jul 09 14:00:00.526707 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.526688 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:00:00.527180 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.527160 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 14:00:00.529934 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.529903 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4"] Jul 09 14:00:00.538046 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.538021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wkswv"] Jul 09 14:00:00.619128 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:00.619128 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr672\" (UniqueName: \"kubernetes.io/projected/0eb56b35-896d-47d4-b268-fd3e99165c03-kube-api-access-cr672\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-certificates\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-installation-pull-secrets\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmwl2\" (UniqueName: \"kubernetes.io/projected/56d3ab1c-770e-4eab-9f51-f74d95b083df-kube-api-access-cmwl2\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2805060-7d9d-4076-bed7-99c5ed5f1325-tmp\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0eb56b35-896d-47d4-b268-fd3e99165c03-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2805060-7d9d-4076-bed7-99c5ed5f1325-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2805060-7d9d-4076-bed7-99c5ed5f1325-serving-cert\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.619365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34506a96-b741-46b1-b3ad-f15dbc4806e2-serving-cert\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vmw4\" (UniqueName: \"kubernetes.io/projected/529c02c0-19d9-4459-a5cc-7a7204380773-kube-api-access-9vmw4\") pod \"network-check-source-989f8b8dc-9rgzs\" (UID: \"529c02c0-19d9-4459-a5cc-7a7204380773\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2805060-7d9d-4076-bed7-99c5ed5f1325-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34506a96-b741-46b1-b3ad-f15dbc4806e2-trusted-ca\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb56b35-896d-47d4-b268-fd3e99165c03-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9fv\" (UniqueName: \"kubernetes.io/projected/b2805060-7d9d-4076-bed7-99c5ed5f1325-kube-api-access-5r9fv\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-trusted-ca\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34506a96-b741-46b1-b3ad-f15dbc4806e2-config\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.619700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-bound-sa-token\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.620083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-image-registry-private-configuration\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.620083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rztj2\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-kube-api-access-rztj2\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.620083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvrld\" (UniqueName: \"kubernetes.io/projected/34506a96-b741-46b1-b3ad-f15dbc4806e2-kube-api-access-xvrld\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.620083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-ca-trust-extracted\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.620083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.619860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2805060-7d9d-4076-bed7-99c5ed5f1325-snapshots\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.620520 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.620230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34506a96-b741-46b1-b3ad-f15dbc4806e2-config\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.620654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.620635 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34506a96-b741-46b1-b3ad-f15dbc4806e2-trusted-ca\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.621989 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.621969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34506a96-b741-46b1-b3ad-f15dbc4806e2-serving-cert\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.628150 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.628128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvrld\" (UniqueName: \"kubernetes.io/projected/34506a96-b741-46b1-b3ad-f15dbc4806e2-kube-api-access-xvrld\") pod \"console-operator-68b757fb67-4nqmg\" (UID: \"34506a96-b741-46b1-b3ad-f15dbc4806e2\") " pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.679482 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.679396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:00.714327 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.714300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:00.720717 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb56b35-896d-47d4-b268-fd3e99165c03-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.720876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9fv\" (UniqueName: \"kubernetes.io/projected/b2805060-7d9d-4076-bed7-99c5ed5f1325-kube-api-access-5r9fv\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.720876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.720876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-trusted-ca\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.720876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-bound-sa-token\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.720876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-image-registry-private-configuration\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rztj2\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-kube-api-access-rztj2\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-ca-trust-extracted\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2805060-7d9d-4076-bed7-99c5ed5f1325-snapshots\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.720980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721005 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr672\" (UniqueName: \"kubernetes.io/projected/0eb56b35-896d-47d4-b268-fd3e99165c03-kube-api-access-cr672\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-certificates\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-installation-pull-secrets\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmwl2\" (UniqueName: \"kubernetes.io/projected/56d3ab1c-770e-4eab-9f51-f74d95b083df-kube-api-access-cmwl2\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2805060-7d9d-4076-bed7-99c5ed5f1325-tmp\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0eb56b35-896d-47d4-b268-fd3e99165c03-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2805060-7d9d-4076-bed7-99c5ed5f1325-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:00.721176 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:00.721196 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7649b6fdf6-6mg2t: secret "image-registry-tls" not found Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:00.721216 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:00.721266 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls podName:dd3bdf4c-a791-44b2-be54-d9f5eb988ec7 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:01.221244515 +0000 UTC m=+235.165852253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls") pod "image-registry-7649b6fdf6-6mg2t" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7") : secret "image-registry-tls" not found Jul 09 14:00:00.721282 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:00.721286 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls podName:56d3ab1c-770e-4eab-9f51-f74d95b083df nodeName:}" failed. No retries permitted until 2026-07-09 14:00:01.221275959 +0000 UTC m=+235.165883682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-khwn2" (UID: "56d3ab1c-770e-4eab-9f51-f74d95b083df") : secret "samples-operator-tls" not found Jul 09 14:00:00.722049 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2805060-7d9d-4076-bed7-99c5ed5f1325-serving-cert\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.722049 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vmw4\" (UniqueName: \"kubernetes.io/projected/529c02c0-19d9-4459-a5cc-7a7204380773-kube-api-access-9vmw4\") pod \"network-check-source-989f8b8dc-9rgzs\" (UID: \"529c02c0-19d9-4459-a5cc-7a7204380773\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" Jul 09 14:00:00.722049 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.721355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2805060-7d9d-4076-bed7-99c5ed5f1325-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.722212 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.722161 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-ca-trust-extracted\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.722266 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.722233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0eb56b35-896d-47d4-b268-fd3e99165c03-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.722505 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.722466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2805060-7d9d-4076-bed7-99c5ed5f1325-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.722505 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.722487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2805060-7d9d-4076-bed7-99c5ed5f1325-tmp\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.722622 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.722514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2805060-7d9d-4076-bed7-99c5ed5f1325-snapshots\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.722975 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.722948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-trusted-ca\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.723231 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.723206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-certificates\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.723392 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.723315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2805060-7d9d-4076-bed7-99c5ed5f1325-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.723980 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.723957 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2805060-7d9d-4076-bed7-99c5ed5f1325-serving-cert\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.724613 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.724591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb56b35-896d-47d4-b268-fd3e99165c03-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.724812 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.724781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-image-registry-private-configuration\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.725183 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.725167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-installation-pull-secrets\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.733065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.733038 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9fv\" (UniqueName: \"kubernetes.io/projected/b2805060-7d9d-4076-bed7-99c5ed5f1325-kube-api-access-5r9fv\") pod \"insights-operator-5c847dcfc4-wkswv\" (UID: \"b2805060-7d9d-4076-bed7-99c5ed5f1325\") " pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.734634 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.734586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vmw4\" (UniqueName: \"kubernetes.io/projected/529c02c0-19d9-4459-a5cc-7a7204380773-kube-api-access-9vmw4\") pod \"network-check-source-989f8b8dc-9rgzs\" (UID: \"529c02c0-19d9-4459-a5cc-7a7204380773\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" Jul 09 14:00:00.735630 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.735579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-bound-sa-token\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.736182 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.736158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmwl2\" (UniqueName: \"kubernetes.io/projected/56d3ab1c-770e-4eab-9f51-f74d95b083df-kube-api-access-cmwl2\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:00.736328 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.736307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr672\" (UniqueName: \"kubernetes.io/projected/0eb56b35-896d-47d4-b268-fd3e99165c03-kube-api-access-cr672\") pod \"kube-storage-version-migrator-operator-846bf668f7-6blp4\" (UID: \"0eb56b35-896d-47d4-b268-fd3e99165c03\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.736834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.736816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rztj2\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-kube-api-access-rztj2\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:00.781015 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.780702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:00.802755 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.802726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" Jul 09 14:00:00.832891 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.832859 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" Jul 09 14:00:00.837066 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.837050 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" Jul 09 14:00:00.846776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.846746 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4nqmg"] Jul 09 14:00:00.850681 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:00.850654 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34506a96_b741_46b1_b3ad_f15dbc4806e2.slice/crio-050c63e9bf7fbd9b412d96aa6961ad7e699d3c7f70b207cee5b48ce84be09901 WatchSource:0}: Error finding container 050c63e9bf7fbd9b412d96aa6961ad7e699d3c7f70b207cee5b48ce84be09901: Status 404 returned error can't find the container with id 050c63e9bf7fbd9b412d96aa6961ad7e699d3c7f70b207cee5b48ce84be09901 Jul 09 14:00:00.957686 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.957612 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs"] Jul 09 14:00:00.958075 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:00.958048 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529c02c0_19d9_4459_a5cc_7a7204380773.slice/crio-cbf736b7e65735a43ed75252129175c157d1acbb90adf325fe51c40c273dc1a1 WatchSource:0}: Error finding container cbf736b7e65735a43ed75252129175c157d1acbb90adf325fe51c40c273dc1a1: Status 404 returned error can't find the container with id cbf736b7e65735a43ed75252129175c157d1acbb90adf325fe51c40c273dc1a1 Jul 09 14:00:00.976389 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.976360 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4"] Jul 09 14:00:00.982578 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:00.982554 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb56b35_896d_47d4_b268_fd3e99165c03.slice/crio-6da051ca8f4e56166b4b884bced2e3fed16bbe758ad993d15cfc9d1e0f36d52b WatchSource:0}: Error finding container 6da051ca8f4e56166b4b884bced2e3fed16bbe758ad993d15cfc9d1e0f36d52b: Status 404 returned error can't find the container with id 6da051ca8f4e56166b4b884bced2e3fed16bbe758ad993d15cfc9d1e0f36d52b Jul 09 14:00:00.994292 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:00.994267 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wkswv"] Jul 09 14:00:00.996683 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:00.996661 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2805060_7d9d_4076_bed7_99c5ed5f1325.slice/crio-eca82607089056b855304215ad1ab30d7fe626d06514e43e6191f5a831843834 WatchSource:0}: Error finding container eca82607089056b855304215ad1ab30d7fe626d06514e43e6191f5a831843834: Status 404 returned error can't find the container with id eca82607089056b855304215ad1ab30d7fe626d06514e43e6191f5a831843834 Jul 09 14:00:01.224736 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.224651 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:01.224736 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.224705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:01.224946 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:01.224797 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:00:01.224946 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:01.224801 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:00:01.224946 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:01.224820 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7649b6fdf6-6mg2t: secret "image-registry-tls" not found Jul 09 14:00:01.224946 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:01.224850 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls podName:56d3ab1c-770e-4eab-9f51-f74d95b083df nodeName:}" failed. No retries permitted until 2026-07-09 14:00:02.224838081 +0000 UTC m=+236.169445804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-khwn2" (UID: "56d3ab1c-770e-4eab-9f51-f74d95b083df") : secret "samples-operator-tls" not found Jul 09 14:00:01.224946 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:01.224913 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls podName:dd3bdf4c-a791-44b2-be54-d9f5eb988ec7 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:02.224857291 +0000 UTC m=+236.169465014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls") pod "image-registry-7649b6fdf6-6mg2t" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7") : secret "image-registry-tls" not found Jul 09 14:00:01.314773 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.314729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" event={"ID":"b2805060-7d9d-4076-bed7-99c5ed5f1325","Type":"ContainerStarted","Data":"eca82607089056b855304215ad1ab30d7fe626d06514e43e6191f5a831843834"} Jul 09 14:00:01.315928 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.315893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" event={"ID":"0eb56b35-896d-47d4-b268-fd3e99165c03","Type":"ContainerStarted","Data":"6da051ca8f4e56166b4b884bced2e3fed16bbe758ad993d15cfc9d1e0f36d52b"} Jul 09 14:00:01.316982 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.316949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" event={"ID":"34506a96-b741-46b1-b3ad-f15dbc4806e2","Type":"ContainerStarted","Data":"050c63e9bf7fbd9b412d96aa6961ad7e699d3c7f70b207cee5b48ce84be09901"} Jul 09 14:00:01.318396 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.318372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" event={"ID":"529c02c0-19d9-4459-a5cc-7a7204380773","Type":"ContainerStarted","Data":"f87ac0b364f67b9406e2a0d23ab84647d31470248c8aa8216368a3a0cddab1d2"} Jul 09 14:00:01.318503 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.318415 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" event={"ID":"529c02c0-19d9-4459-a5cc-7a7204380773","Type":"ContainerStarted","Data":"cbf736b7e65735a43ed75252129175c157d1acbb90adf325fe51c40c273dc1a1"} Jul 09 14:00:01.335254 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:01.335214 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-9rgzs" podStartSLOduration=1.335201263 podStartE2EDuration="1.335201263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:01.334671772 +0000 UTC m=+235.279279519" watchObservedRunningTime="2026-07-09 14:00:01.335201263 +0000 UTC m=+235.279809001" Jul 09 14:00:02.235313 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:02.235271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:02.235844 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:02.235379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:02.235844 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:02.235464 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:00:02.235844 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:02.235542 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls podName:56d3ab1c-770e-4eab-9f51-f74d95b083df nodeName:}" failed. No retries permitted until 2026-07-09 14:00:04.235521706 +0000 UTC m=+238.180129456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-khwn2" (UID: "56d3ab1c-770e-4eab-9f51-f74d95b083df") : secret "samples-operator-tls" not found Jul 09 14:00:02.235844 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:02.235545 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:00:02.235844 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:02.235566 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7649b6fdf6-6mg2t: secret "image-registry-tls" not found Jul 09 14:00:02.235844 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:02.235622 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls podName:dd3bdf4c-a791-44b2-be54-d9f5eb988ec7 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:04.235605076 +0000 UTC m=+238.180212816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls") pod "image-registry-7649b6fdf6-6mg2t" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7") : secret "image-registry-tls" not found Jul 09 14:00:02.617231 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:02.617188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:02.714669 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:02.714628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:04.253930 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:04.253873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:04.254680 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:04.253966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:04.254680 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:04.254150 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:00:04.254680 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:04.254213 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls podName:56d3ab1c-770e-4eab-9f51-f74d95b083df nodeName:}" failed. No retries permitted until 2026-07-09 14:00:08.254193324 +0000 UTC m=+242.198801050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-khwn2" (UID: "56d3ab1c-770e-4eab-9f51-f74d95b083df") : secret "samples-operator-tls" not found Jul 09 14:00:04.254680 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:04.254575 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:00:04.254680 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:04.254594 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7649b6fdf6-6mg2t: secret "image-registry-tls" not found Jul 09 14:00:04.254680 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:04.254650 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls podName:dd3bdf4c-a791-44b2-be54-d9f5eb988ec7 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:08.254633448 +0000 UTC m=+242.199241185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls") pod "image-registry-7649b6fdf6-6mg2t" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7") : secret "image-registry-tls" not found Jul 09 14:00:04.303017 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:04.302986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:04.723115 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:04.723026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:04.818791 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:04.818753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:05.037297 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.037269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:05.311889 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.311807 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:05.335122 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.335090 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/0.log" Jul 09 14:00:05.335291 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.335131 2559 generic.go:356] "Generic (PLEG): container finished" podID="34506a96-b741-46b1-b3ad-f15dbc4806e2" containerID="a5452e015de75a38b84ccb0e1dd0523cc5c41595fa98d09cabb1d97683327ad0" exitCode=255 Jul 09 14:00:05.335291 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.335092 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh"] Jul 09 14:00:05.335607 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.335590 2559 scope.go:117] "RemoveContainer" containerID="a5452e015de75a38b84ccb0e1dd0523cc5c41595fa98d09cabb1d97683327ad0" Jul 09 14:00:05.337637 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.337613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" event={"ID":"34506a96-b741-46b1-b3ad-f15dbc4806e2","Type":"ContainerDied","Data":"a5452e015de75a38b84ccb0e1dd0523cc5c41595fa98d09cabb1d97683327ad0"} Jul 09 14:00:05.337789 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.337773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" event={"ID":"b2805060-7d9d-4076-bed7-99c5ed5f1325","Type":"ContainerStarted","Data":"7074db0b6f5892fed59bf1eb18a1f138ee6a587bf39e0d1d3a823fe3f5082eb3"} Jul 09 14:00:05.337903 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.337692 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" Jul 09 14:00:05.338588 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.338562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" event={"ID":"0eb56b35-896d-47d4-b268-fd3e99165c03","Type":"ContainerStarted","Data":"e3eccddf9cef83df97d414aabd56c74ac48c132d5aa08fa0f5ff2ed940ea310d"} Jul 09 14:00:05.340658 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.340636 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 14:00:05.340950 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.340928 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 14:00:05.341627 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.341610 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zkfkw\"" Jul 09 14:00:05.352966 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.352574 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh"] Jul 09 14:00:05.423610 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.423561 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" podStartSLOduration=2.072697283 podStartE2EDuration="5.423545143s" totalImagesPullingTime="3.35084786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:05.42339079 +0000 UTC m=+239.367998534" watchObservedRunningTime="2026-07-09 14:00:05.423545143 +0000 UTC m=+239.368152888" Jul 09 14:00:05.456452 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.456297 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" podStartSLOduration=2.122457577 podStartE2EDuration="5.456274505s" totalImagesPullingTime="3.333816928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:05.455506016 +0000 UTC m=+239.400113762" watchObservedRunningTime="2026-07-09 14:00:05.456274505 +0000 UTC m=+239.400882251" Jul 09 14:00:05.464780 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.464744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb656\" (UniqueName: \"kubernetes.io/projected/99c4fba7-80c2-4adb-8ede-1cc4f4437260-kube-api-access-fb656\") pod \"migrator-d57d58cc9-lvqzh\" (UID: \"99c4fba7-80c2-4adb-8ede-1cc4f4437260\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" Jul 09 14:00:05.565748 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.565655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb656\" (UniqueName: \"kubernetes.io/projected/99c4fba7-80c2-4adb-8ede-1cc4f4437260-kube-api-access-fb656\") pod \"migrator-d57d58cc9-lvqzh\" (UID: \"99c4fba7-80c2-4adb-8ede-1cc4f4437260\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" Jul 09 14:00:05.575176 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.575144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb656\" (UniqueName: \"kubernetes.io/projected/99c4fba7-80c2-4adb-8ede-1cc4f4437260-kube-api-access-fb656\") pod \"migrator-d57d58cc9-lvqzh\" (UID: \"99c4fba7-80c2-4adb-8ede-1cc4f4437260\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" Jul 09 14:00:05.653808 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.653773 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" Jul 09 14:00:05.672741 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.672710 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpg9m"] Jul 09 14:00:05.675400 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.675379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.679065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.678991 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:00:05.679065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.679045 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:00:05.679330 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.679316 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kq44v\"" Jul 09 14:00:05.692548 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.692525 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpg9m"] Jul 09 14:00:05.701947 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.701881 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:05.766921 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.766888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08fa4059-32a1-47e2-be45-46faa1945b8d-data-volume\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.767084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.766938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.767084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.766963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5dvh\" (UniqueName: \"kubernetes.io/projected/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-api-access-m5dvh\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.767084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.766986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.767197 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.767103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08fa4059-32a1-47e2-be45-46faa1945b8d-crio-socket\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.768852 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.768828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:05.780483 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.780462 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh"] Jul 09 14:00:05.783078 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:05.783057 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c4fba7_80c2_4adb_8ede_1cc4f4437260.slice/crio-a4d9c1fe747831fef79c897c85a2ab059b27604efb7b33dd31da8eda7c4728f2 WatchSource:0}: Error finding container a4d9c1fe747831fef79c897c85a2ab059b27604efb7b33dd31da8eda7c4728f2: Status 404 returned error can't find the container with id a4d9c1fe747831fef79c897c85a2ab059b27604efb7b33dd31da8eda7c4728f2 Jul 09 14:00:05.868064 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.867977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08fa4059-32a1-47e2-be45-46faa1945b8d-crio-socket\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.868064 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.868041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08fa4059-32a1-47e2-be45-46faa1945b8d-data-volume\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.868064 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.868065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.868305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.868082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5dvh\" (UniqueName: \"kubernetes.io/projected/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-api-access-m5dvh\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.868305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.868099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.868305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.868134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08fa4059-32a1-47e2-be45-46faa1945b8d-crio-socket\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.868305 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:05.868212 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:00:05.868305 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:05.868269 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:06.368253842 +0000 UTC m=+240.312861567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:00:05.868590 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:05.868361 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:00:05.868590 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:05.868430 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:06.3684127 +0000 UTC m=+240.313020442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : configmap "kube-rbac-proxy" not found Jul 09 14:00:05.868590 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.868506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08fa4059-32a1-47e2-be45-46faa1945b8d-data-volume\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:05.877218 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:05.877200 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5dvh\" (UniqueName: \"kubernetes.io/projected/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-api-access-m5dvh\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:06.343486 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.343435 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/1.log" Jul 09 14:00:06.343905 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.343799 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/0.log" Jul 09 14:00:06.343905 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.343831 2559 generic.go:356] "Generic (PLEG): container finished" podID="34506a96-b741-46b1-b3ad-f15dbc4806e2" containerID="f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5" exitCode=255 Jul 09 14:00:06.344005 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.343908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" event={"ID":"34506a96-b741-46b1-b3ad-f15dbc4806e2","Type":"ContainerDied","Data":"f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5"} Jul 09 14:00:06.344005 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.343949 2559 scope.go:117] "RemoveContainer" containerID="a5452e015de75a38b84ccb0e1dd0523cc5c41595fa98d09cabb1d97683327ad0" Jul 09 14:00:06.344191 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.344172 2559 scope.go:117] "RemoveContainer" containerID="f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5" Jul 09 14:00:06.344395 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:06.344374 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4nqmg_openshift-console-operator(34506a96-b741-46b1-b3ad-f15dbc4806e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podUID="34506a96-b741-46b1-b3ad-f15dbc4806e2" Jul 09 14:00:06.345194 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.344979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" event={"ID":"99c4fba7-80c2-4adb-8ede-1cc4f4437260","Type":"ContainerStarted","Data":"a4d9c1fe747831fef79c897c85a2ab059b27604efb7b33dd31da8eda7c4728f2"} Jul 09 14:00:06.372626 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.372599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:06.372766 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.372633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:06.372766 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:06.372726 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:00:06.372766 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:06.372757 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:00:06.372890 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:06.372778 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:07.372764597 +0000 UTC m=+241.317372324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : configmap "kube-rbac-proxy" not found Jul 09 14:00:06.372890 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:06.372807 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:07.372790258 +0000 UTC m=+241.317397981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:00:06.690754 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.690672 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:06.764193 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:06.764154 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:07.349289 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:07.349254 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/1.log" Jul 09 14:00:07.349743 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:07.349592 2559 scope.go:117] "RemoveContainer" containerID="f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5" Jul 09 14:00:07.349799 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:07.349753 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4nqmg_openshift-console-operator(34506a96-b741-46b1-b3ad-f15dbc4806e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podUID="34506a96-b741-46b1-b3ad-f15dbc4806e2" Jul 09 14:00:07.382992 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:07.382961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:07.383174 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:07.382997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:07.383174 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:07.383077 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:00:07.383174 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:07.383126 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:00:07.383174 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:07.383133 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:09.383118342 +0000 UTC m=+243.327726067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : configmap "kube-rbac-proxy" not found Jul 09 14:00:07.383396 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:07.383197 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:09.38317757 +0000 UTC m=+243.327785308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:00:07.722978 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:07.722894 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:08.248492 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.248467 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gslzq_c999078b-b4f6-45f5-b976-a893c69e9e5b/dns-node-resolver/0.log" Jul 09 14:00:08.291854 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.291813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:08.291990 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.291891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:08.291990 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:08.291975 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:00:08.292059 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:08.291990 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:00:08.292059 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:08.291993 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7649b6fdf6-6mg2t: secret "image-registry-tls" not found Jul 09 14:00:08.292120 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:08.292062 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls podName:56d3ab1c-770e-4eab-9f51-f74d95b083df nodeName:}" failed. No retries permitted until 2026-07-09 14:00:16.292038207 +0000 UTC m=+250.236645949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-khwn2" (UID: "56d3ab1c-770e-4eab-9f51-f74d95b083df") : secret "samples-operator-tls" not found Jul 09 14:00:08.292120 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:08.292077 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls podName:dd3bdf4c-a791-44b2-be54-d9f5eb988ec7 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:16.292071673 +0000 UTC m=+250.236679410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls") pod "image-registry-7649b6fdf6-6mg2t" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7") : secret "image-registry-tls" not found Jul 09 14:00:08.354181 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.354145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" event={"ID":"99c4fba7-80c2-4adb-8ede-1cc4f4437260","Type":"ContainerStarted","Data":"538b0991b9fb3ef7804f4b5954aecd785ac7d185b92b07c2e61908c0f9424bbe"} Jul 09 14:00:08.354590 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.354206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" event={"ID":"99c4fba7-80c2-4adb-8ede-1cc4f4437260","Type":"ContainerStarted","Data":"81be7db0374323cbcfc02198e7cf9aa881a93abb0dc0a6b4caf95fac68ab9af5"} Jul 09 14:00:08.372114 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.372068 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lvqzh" podStartSLOduration=1.233883478 podStartE2EDuration="3.372048396s" totalImagesPullingTime="2.138164918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:08.370914409 +0000 UTC m=+242.315522155" watchObservedRunningTime="2026-07-09 14:00:08.372048396 +0000 UTC m=+242.316656144" Jul 09 14:00:08.528433 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.528324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:08.668034 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.668008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:08.854528 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.854426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:08.964159 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:08.964121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:09.068978 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:09.068943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:09.167156 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:09.167065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:09.265955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:09.265915 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:09.400529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:09.400486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:09.400529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:09.400532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:09.400994 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:09.400606 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:00:09.400994 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:09.400638 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:00:09.400994 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:09.400689 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:13.4006679 +0000 UTC m=+247.345275629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : configmap "kube-rbac-proxy" not found Jul 09 14:00:09.400994 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:09.400790 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:13.400779269 +0000 UTC m=+247.345386996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:00:09.647642 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:09.647618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqhnt_ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba/node-ca/0.log" Jul 09 14:00:10.219494 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.219456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:10.447734 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.447706 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rffpl_99566bc4-d1c4-4c5c-8b6b-67fb5989faad/serve-healthcheck-canary/0.log" Jul 09 14:00:10.450293 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.450270 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:10.647766 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.647719 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lvqzh_99c4fba7-80c2-4adb-8ede-1cc4f4437260/migrator/0.log" Jul 09 14:00:10.715214 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.715181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:10.715372 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.715242 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:10.715627 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.715610 2559 scope.go:117] "RemoveContainer" containerID="f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5" Jul 09 14:00:10.715811 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:10.715789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4nqmg_openshift-console-operator(34506a96-b741-46b1-b3ad-f15dbc4806e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podUID="34506a96-b741-46b1-b3ad-f15dbc4806e2" Jul 09 14:00:10.814954 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.814924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:10.847546 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:10.847511 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lvqzh_99c4fba7-80c2-4adb-8ede-1cc4f4437260/graceful-termination/0.log" Jul 09 14:00:11.016940 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:11.016904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:11.048692 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:11.048661 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-6blp4_0eb56b35-896d-47d4-b268-fd3e99165c03/kube-storage-version-migrator-operator/0.log" Jul 09 14:00:11.622209 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:11.622157 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:11.738141 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:11.738087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.019424 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:12.019394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.415341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:12.415226 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.522098 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:12.522064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.622769 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:12.622700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.722655 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:12.722564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.015601 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:13.015574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.437341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:13.437259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:13.437341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:13.437294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:13.437557 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:13.437389 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:00:13.437557 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:13.437420 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:00:13.437557 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:13.437460 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:21.437428873 +0000 UTC m=+255.382036599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : configmap "kube-rbac-proxy" not found Jul 09 14:00:13.437557 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:13.437494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls podName:08fa4059-32a1-47e2-be45-46faa1945b8d nodeName:}" failed. No retries permitted until 2026-07-09 14:00:21.43747715 +0000 UTC m=+255.382084877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpg9m" (UID: "08fa4059-32a1-47e2-be45-46faa1945b8d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:00:13.608822 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:13.608775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:14.218040 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:14.218002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:14.489563 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:14.489479 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:14.615535 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:14.615503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:14.929620 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:14.929584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:15.029586 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:15.029552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:15.614837 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:15.614806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:16.224056 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.224027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:16.364672 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.364637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:16.364831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.364752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:16.367285 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.367265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"image-registry-7649b6fdf6-6mg2t\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:16.367349 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.367335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d3ab1c-770e-4eab-9f51-f74d95b083df-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-khwn2\" (UID: \"56d3ab1c-770e-4eab-9f51-f74d95b083df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:16.411198 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.411167 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zgdmc\"" Jul 09 14:00:16.413883 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.413861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:16.419887 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.419860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" Jul 09 14:00:16.426942 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.426921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-blxcx\"" Jul 09 14:00:16.435183 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.435161 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:16.558296 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.558206 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2"] Jul 09 14:00:16.583761 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:16.580915 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7649b6fdf6-6mg2t"] Jul 09 14:00:16.587894 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:16.587871 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3bdf4c_a791_44b2_be54_d9f5eb988ec7.slice/crio-14a402dff0bff34c386e5afe710a8c121a38bc1fda0511cb7a23b67f37ec965d WatchSource:0}: Error finding container 14a402dff0bff34c386e5afe710a8c121a38bc1fda0511cb7a23b67f37ec965d: Status 404 returned error can't find the container with id 14a402dff0bff34c386e5afe710a8c121a38bc1fda0511cb7a23b67f37ec965d Jul 09 14:00:17.249142 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.249108 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:17.349944 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.349902 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:17.385859 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.385823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" event={"ID":"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7","Type":"ContainerStarted","Data":"b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5"} Jul 09 14:00:17.386060 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.385886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" event={"ID":"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7","Type":"ContainerStarted","Data":"14a402dff0bff34c386e5afe710a8c121a38bc1fda0511cb7a23b67f37ec965d"} Jul 09 14:00:17.386060 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.385923 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:17.387000 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.386976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" event={"ID":"56d3ab1c-770e-4eab-9f51-f74d95b083df","Type":"ContainerStarted","Data":"cc6ded783f2655e86e4117bedef5e76d6f523a56f0a1169f6f0389f3cb345959"} Jul 09 14:00:17.407034 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.406978 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" podStartSLOduration=17.406960517 podStartE2EDuration="17.406960517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:17.406768393 +0000 UTC m=+251.351376138" watchObservedRunningTime="2026-07-09 14:00:17.406960517 +0000 UTC m=+251.351568266" Jul 09 14:00:17.788958 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.788926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:17.850067 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:17.850018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:18.215281 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.215191 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:18.481222 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.481132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 14:00:18.483918 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.483880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ec132f3-35d0-4fe6-b288-155949da7001-metrics-certs\") pod \"network-metrics-daemon-6wrzb\" (UID: \"3ec132f3-35d0-4fe6-b288-155949da7001\") " pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 14:00:18.545124 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.545087 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qkthd\"" Jul 09 14:00:18.553019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.552989 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wrzb" Jul 09 14:00:18.690881 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.690850 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6wrzb"] Jul 09 14:00:18.779772 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.779735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:18.839723 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:18.839690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:19.024614 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.024585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:19.099825 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:19.099755 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec132f3_35d0_4fe6_b288_155949da7001.slice/crio-4c223c016d5443f53d022686d644374d629afb5a01ff27bd3c1deaa8905ef44d WatchSource:0}: Error finding container 4c223c016d5443f53d022686d644374d629afb5a01ff27bd3c1deaa8905ef44d: Status 404 returned error can't find the container with id 4c223c016d5443f53d022686d644374d629afb5a01ff27bd3c1deaa8905ef44d Jul 09 14:00:19.216994 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.216967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:19.395504 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.395403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wrzb" event={"ID":"3ec132f3-35d0-4fe6-b288-155949da7001","Type":"ContainerStarted","Data":"4c223c016d5443f53d022686d644374d629afb5a01ff27bd3c1deaa8905ef44d"} Jul 09 14:00:19.397221 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.397193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" event={"ID":"56d3ab1c-770e-4eab-9f51-f74d95b083df","Type":"ContainerStarted","Data":"641eb75f80a31c24436b6bb72b9530c25ba8fe26a8ab3ee93b0aa2de2b9c0be1"} Jul 09 14:00:19.397329 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.397242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" event={"ID":"56d3ab1c-770e-4eab-9f51-f74d95b083df","Type":"ContainerStarted","Data":"81d2c6c0e55d4dbadb652707cba4e160ae77b870b8264b9356916106575244b7"} Jul 09 14:00:19.413489 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.413415 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-khwn2" podStartSLOduration=16.871150123 podStartE2EDuration="19.413397639s" totalImagesPullingTime="2.542247516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:19.413189369 +0000 UTC m=+253.357797114" watchObservedRunningTime="2026-07-09 14:00:19.413397639 +0000 UTC m=+253.358005385" Jul 09 14:00:19.549651 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.549613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:19.944782 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:19.944729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:20.090724 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:20.090685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:20.312471 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:20.312412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:20.402303 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:20.402274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wrzb" event={"ID":"3ec132f3-35d0-4fe6-b288-155949da7001","Type":"ContainerStarted","Data":"236b79f7476098d3da9cb97d60b7369a2225e5d30666a44bdf97f9f4b1ad6e84"} Jul 09 14:00:21.406664 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.406624 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wrzb" event={"ID":"3ec132f3-35d0-4fe6-b288-155949da7001","Type":"ContainerStarted","Data":"34a4b2a05e61cb151ebde1b34a60bd178357a64467446b118e912be6566fffaa"} Jul 09 14:00:21.423219 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.423168 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6wrzb" podStartSLOduration=253.262315524 podStartE2EDuration="4m14.423154007s" totalImagesPullingTime="1.160838483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:21.422409153 +0000 UTC m=+255.367016911" watchObservedRunningTime="2026-07-09 14:00:21.423154007 +0000 UTC m=+255.367761761" Jul 09 14:00:21.509434 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.509397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:21.509583 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.509437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:21.510147 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.510120 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08fa4059-32a1-47e2-be45-46faa1945b8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:21.512035 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.512017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08fa4059-32a1-47e2-be45-46faa1945b8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpg9m\" (UID: \"08fa4059-32a1-47e2-be45-46faa1945b8d\") " pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:21.586667 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.586639 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kq44v\"" Jul 09 14:00:21.594615 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.594593 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpg9m" Jul 09 14:00:21.741791 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:21.741759 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpg9m"] Jul 09 14:00:21.744871 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:21.744840 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08fa4059_32a1_47e2_be45_46faa1945b8d.slice/crio-4e8a0e74634b2e08b5ba55cc2f03831ca91011e7bf38beb376a2f7f4ebce8d1d WatchSource:0}: Error finding container 4e8a0e74634b2e08b5ba55cc2f03831ca91011e7bf38beb376a2f7f4ebce8d1d: Status 404 returned error can't find the container with id 4e8a0e74634b2e08b5ba55cc2f03831ca91011e7bf38beb376a2f7f4ebce8d1d Jul 09 14:00:22.413408 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:22.413372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpg9m" event={"ID":"08fa4059-32a1-47e2-be45-46faa1945b8d","Type":"ContainerStarted","Data":"4e8a0e74634b2e08b5ba55cc2f03831ca91011e7bf38beb376a2f7f4ebce8d1d"} Jul 09 14:00:24.376771 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:24.376742 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:25.641243 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:25.641209 2559 scope.go:117] "RemoveContainer" containerID="f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5" Jul 09 14:00:26.430871 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.430834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpg9m" event={"ID":"08fa4059-32a1-47e2-be45-46faa1945b8d","Type":"ContainerStarted","Data":"bb018ad9d89fc458b6d34a440dce69be25d0c8eec7beb05abf65ae535da14985"} Jul 09 14:00:26.431068 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.430942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpg9m" event={"ID":"08fa4059-32a1-47e2-be45-46faa1945b8d","Type":"ContainerStarted","Data":"65652bf4faa583a6cbaae94b02be4c5cc91ad97d38f9affe1a13fa30c336827a"} Jul 09 14:00:26.432246 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.432226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:00:26.432643 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.432626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/1.log" Jul 09 14:00:26.432692 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.432663 2559 generic.go:356] "Generic (PLEG): container finished" podID="34506a96-b741-46b1-b3ad-f15dbc4806e2" containerID="fb6e71328a3e4424c78bb06d3cb3e39cc4a098ae89ac56a305e3093230543eb1" exitCode=255 Jul 09 14:00:26.432862 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.432705 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" event={"ID":"34506a96-b741-46b1-b3ad-f15dbc4806e2","Type":"ContainerDied","Data":"fb6e71328a3e4424c78bb06d3cb3e39cc4a098ae89ac56a305e3093230543eb1"} Jul 09 14:00:26.432862 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.432751 2559 scope.go:117] "RemoveContainer" containerID="f414da752ba9ff216996dce0f0845466260928e876adb3c28ba122fee193d5f5" Jul 09 14:00:26.433059 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:26.433043 2559 scope.go:117] "RemoveContainer" containerID="fb6e71328a3e4424c78bb06d3cb3e39cc4a098ae89ac56a305e3093230543eb1" Jul 09 14:00:26.433322 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:26.433292 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-4nqmg_openshift-console-operator(34506a96-b741-46b1-b3ad-f15dbc4806e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podUID="34506a96-b741-46b1-b3ad-f15dbc4806e2" Jul 09 14:00:27.438417 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:27.438385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:00:28.029776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:28.029731 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:29.448180 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:29.448146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpg9m" event={"ID":"08fa4059-32a1-47e2-be45-46faa1945b8d","Type":"ContainerStarted","Data":"9166fb01ecc4fb1e7b4b628e971c7d7b9c6613e9db3198e1514dad2b0dcb0a1a"} Jul 09 14:00:29.467240 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:29.467187 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpg9m" podStartSLOduration=17.748708683 podStartE2EDuration="24.467172207s" totalImagesPullingTime="6.718463524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:00:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:29.465981056 +0000 UTC m=+263.410588802" watchObservedRunningTime="2026-07-09 14:00:29.467172207 +0000 UTC m=+263.411779966" Jul 09 14:00:30.153550 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.153509 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7649b6fdf6-6mg2t"] Jul 09 14:00:30.200279 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.200249 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fc886cdd-cd9kx"] Jul 09 14:00:30.202555 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.202540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.224347 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.224320 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc886cdd-cd9kx"] Jul 09 14:00:30.232179 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.232154 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:30.277844 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.277817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4436919c-0415-413d-b847-46d4eb53902c-ca-trust-extracted\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.277988 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.277852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4436919c-0415-413d-b847-46d4eb53902c-trusted-ca\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.277988 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.277870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4436919c-0415-413d-b847-46d4eb53902c-installation-pull-secrets\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.277988 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.277928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qhf\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-kube-api-access-68qhf\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.277988 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.277978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-bound-sa-token\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.278153 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.278002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-registry-tls\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.278153 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.278017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4436919c-0415-413d-b847-46d4eb53902c-registry-certificates\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.278153 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.278119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4436919c-0415-413d-b847-46d4eb53902c-image-registry-private-configuration\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.350783 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.350745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:30.378965 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.378940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4436919c-0415-413d-b847-46d4eb53902c-image-registry-private-configuration\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.378987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4436919c-0415-413d-b847-46d4eb53902c-ca-trust-extracted\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4436919c-0415-413d-b847-46d4eb53902c-trusted-ca\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4436919c-0415-413d-b847-46d4eb53902c-installation-pull-secrets\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qhf\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-kube-api-access-68qhf\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-bound-sa-token\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379351 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-registry-tls\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379351 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4436919c-0415-413d-b847-46d4eb53902c-registry-certificates\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.379475 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.379424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4436919c-0415-413d-b847-46d4eb53902c-ca-trust-extracted\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.380257 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.380225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4436919c-0415-413d-b847-46d4eb53902c-trusted-ca\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.380639 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.380612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4436919c-0415-413d-b847-46d4eb53902c-registry-certificates\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.381864 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.381846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4436919c-0415-413d-b847-46d4eb53902c-image-registry-private-configuration\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.382125 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.382094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4436919c-0415-413d-b847-46d4eb53902c-installation-pull-secrets\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.382125 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.382114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-registry-tls\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.389398 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.389368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-bound-sa-token\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.389920 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.389885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qhf\" (UniqueName: \"kubernetes.io/projected/4436919c-0415-413d-b847-46d4eb53902c-kube-api-access-68qhf\") pod \"image-registry-6fc886cdd-cd9kx\" (UID: \"4436919c-0415-413d-b847-46d4eb53902c\") " pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.511822 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.511792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:30.669876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.669854 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc886cdd-cd9kx"] Jul 09 14:00:30.672028 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:30.672001 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4436919c_0415_413d_b847_46d4eb53902c.slice/crio-a3125b60740dcc74f46a8cc7703e624145036489b9d133d2231d8bbc7e968c3a WatchSource:0}: Error finding container a3125b60740dcc74f46a8cc7703e624145036489b9d133d2231d8bbc7e968c3a: Status 404 returned error can't find the container with id a3125b60740dcc74f46a8cc7703e624145036489b9d133d2231d8bbc7e968c3a Jul 09 14:00:30.672940 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.672913 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:30.715377 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.715356 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:30.715491 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.715410 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:30.715753 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.715737 2559 scope.go:117] "RemoveContainer" containerID="fb6e71328a3e4424c78bb06d3cb3e39cc4a098ae89ac56a305e3093230543eb1" Jul 09 14:00:30.715938 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:30.715920 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-4nqmg_openshift-console-operator(34506a96-b741-46b1-b3ad-f15dbc4806e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podUID="34506a96-b741-46b1-b3ad-f15dbc4806e2" Jul 09 14:00:30.772501 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:30.772409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:31.459646 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:31.459609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" event={"ID":"4436919c-0415-413d-b847-46d4eb53902c","Type":"ContainerStarted","Data":"496a2a6e99da708a22dd15cfb216c7fb3bff6952985f81c0e361b18a8aa37eb0"} Jul 09 14:00:31.459830 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:31.459664 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" event={"ID":"4436919c-0415-413d-b847-46d4eb53902c","Type":"ContainerStarted","Data":"a3125b60740dcc74f46a8cc7703e624145036489b9d133d2231d8bbc7e968c3a"} Jul 09 14:00:31.459830 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:31.459740 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:31.486001 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:31.485943 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" podStartSLOduration=1.485926429 podStartE2EDuration="1.485926429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:31.485592397 +0000 UTC m=+265.430200142" watchObservedRunningTime="2026-07-09 14:00:31.485926429 +0000 UTC m=+265.430534198" Jul 09 14:00:35.134003 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:35.133967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:35.220374 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:35.220338 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:35.770158 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:35.770121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:38.647181 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:38.647146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:40.160349 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:40.160314 2559 patch_prober.go:28] interesting pod/image-registry-7649b6fdf6-6mg2t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 14:00:40.160767 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:40.160370 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" podUID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:00:41.273000 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.272967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:41.399671 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.399638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:41.523539 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.523458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:41.567364 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.567337 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gxn7f"] Jul 09 14:00:41.571351 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.571330 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.573890 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.573870 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mkrgj\"" Jul 09 14:00:41.574060 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.574016 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:00:41.574164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.574106 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:00:41.575166 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.575149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:00:41.575287 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.575225 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:00:41.575287 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.575249 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:00:41.575399 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.575351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:00:41.620793 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.620763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:41.672540 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-root\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672540 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f42df821-1e67-4c45-87e4-520dd9ceb7ca-metrics-client-ca\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672750 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-wtmp\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672750 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672750 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-sys\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672847 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672847 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-textfile\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672847 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-tls\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.672847 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.672843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p7h8\" (UniqueName: \"kubernetes.io/projected/f42df821-1e67-4c45-87e4-520dd9ceb7ca-kube-api-access-8p7h8\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.721882 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.721855 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:41.774084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-textfile\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-tls\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p7h8\" (UniqueName: \"kubernetes.io/projected/f42df821-1e67-4c45-87e4-520dd9ceb7ca-kube-api-access-8p7h8\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-root\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f42df821-1e67-4c45-87e4-520dd9ceb7ca-metrics-client-ca\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-wtmp\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-root\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-textfile\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-wtmp\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-sys\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774533 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42df821-1e67-4c45-87e4-520dd9ceb7ca-sys\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774881 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.774969 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.774941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f42df821-1e67-4c45-87e4-520dd9ceb7ca-metrics-client-ca\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.777288 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.777266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.777394 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.777352 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f42df821-1e67-4c45-87e4-520dd9ceb7ca-node-exporter-tls\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.783194 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.783168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p7h8\" (UniqueName: \"kubernetes.io/projected/f42df821-1e67-4c45-87e4-520dd9ceb7ca-kube-api-access-8p7h8\") pod \"node-exporter-gxn7f\" (UID: \"f42df821-1e67-4c45-87e4-520dd9ceb7ca\") " pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.822429 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.822394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:41.881648 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.881620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gxn7f" Jul 09 14:00:41.921858 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:41.921830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:42.026654 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.026548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:42.221502 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.221420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:42.336368 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.336281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:42.499381 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.499345 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxn7f" event={"ID":"f42df821-1e67-4c45-87e4-520dd9ceb7ca","Type":"ContainerStarted","Data":"22f3e364928d1061f8f44d0b16c58222b3b391bb4ca171d4e2e8ad40f2cc2700"} Jul 09 14:00:42.512484 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.512431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:42.612202 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.612096 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:42.640534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.640490 2559 scope.go:117] "RemoveContainer" containerID="fb6e71328a3e4424c78bb06d3cb3e39cc4a098ae89ac56a305e3093230543eb1" Jul 09 14:00:42.640741 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:42.640702 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-4nqmg_openshift-console-operator(34506a96-b741-46b1-b3ad-f15dbc4806e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podUID="34506a96-b741-46b1-b3ad-f15dbc4806e2" Jul 09 14:00:42.729990 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:42.729952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:43.504006 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.503972 2559 generic.go:356] "Generic (PLEG): container finished" podID="f42df821-1e67-4c45-87e4-520dd9ceb7ca" containerID="e1ccb9a4fff33afc9f2fa0a40f78372ece8023986e7c34c34fde1b623bc2af46" exitCode=0 Jul 09 14:00:43.504359 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.504046 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxn7f" event={"ID":"f42df821-1e67-4c45-87e4-520dd9ceb7ca","Type":"ContainerDied","Data":"e1ccb9a4fff33afc9f2fa0a40f78372ece8023986e7c34c34fde1b623bc2af46"} Jul 09 14:00:43.591301 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.591272 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7"] Jul 09 14:00:43.594857 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.594836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.598418 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.598395 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 14:00:43.598571 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.598553 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-575nki9v12phk\"" Jul 09 14:00:43.598759 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.598708 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 14:00:43.598759 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.598740 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 14:00:43.599253 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.599237 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 14:00:43.599340 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.599256 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cc7t6\"" Jul 09 14:00:43.599340 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.599314 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 14:00:43.613233 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.613213 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7"] Jul 09 14:00:43.692900 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.692860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.692948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.692994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48ptr\" (UniqueName: \"kubernetes.io/projected/8428a350-eda3-4be0-b289-5498cc6dea00-kube-api-access-48ptr\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.693026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-tls\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.693053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.693083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-grpc-tls\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693251 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.693158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.693251 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.693200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8428a350-eda3-4be0-b289-5498cc6dea00-metrics-client-ca\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.713625 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.713601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:43.794285 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794285 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794285 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48ptr\" (UniqueName: \"kubernetes.io/projected/8428a350-eda3-4be0-b289-5498cc6dea00-kube-api-access-48ptr\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794486 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-tls\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794486 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794486 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-grpc-tls\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794486 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.794486 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.794408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8428a350-eda3-4be0-b289-5498cc6dea00-metrics-client-ca\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.795334 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.795241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8428a350-eda3-4be0-b289-5498cc6dea00-metrics-client-ca\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.797574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.797545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-tls\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.797574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.797566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.797723 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.797566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.797776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.797749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.797854 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.797840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-grpc-tls\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.797894 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.797862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8428a350-eda3-4be0-b289-5498cc6dea00-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.803133 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.803109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48ptr\" (UniqueName: \"kubernetes.io/projected/8428a350-eda3-4be0-b289-5498cc6dea00-kube-api-access-48ptr\") pod \"thanos-querier-5c7d4bbb4f-vjxk7\" (UID: \"8428a350-eda3-4be0-b289-5498cc6dea00\") " pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:43.915216 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:43.915180 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:44.062645 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.062619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7"] Jul 09 14:00:44.065038 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:44.065013 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8428a350_eda3_4be0_b289_5498cc6dea00.slice/crio-4237ad5042e546ac609e6d76c67a5c564b3cc64c30b48b3fec2b7b6299ca5816 WatchSource:0}: Error finding container 4237ad5042e546ac609e6d76c67a5c564b3cc64c30b48b3fec2b7b6299ca5816: Status 404 returned error can't find the container with id 4237ad5042e546ac609e6d76c67a5c564b3cc64c30b48b3fec2b7b6299ca5816 Jul 09 14:00:44.509369 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.509331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxn7f" event={"ID":"f42df821-1e67-4c45-87e4-520dd9ceb7ca","Type":"ContainerStarted","Data":"ac36d06aad3cba523f2e03daf6a9cd1d64c1de70a53a88f335238fba05259bc0"} Jul 09 14:00:44.509856 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.509399 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxn7f" event={"ID":"f42df821-1e67-4c45-87e4-520dd9ceb7ca","Type":"ContainerStarted","Data":"0b5387f62a4a871f424cf0c9a8bddd5b6dbc6e7b12545702cd0b71e9d505916c"} Jul 09 14:00:44.510462 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.510427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"4237ad5042e546ac609e6d76c67a5c564b3cc64c30b48b3fec2b7b6299ca5816"} Jul 09 14:00:44.530991 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.530946 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gxn7f" podStartSLOduration=2.558841362 podStartE2EDuration="3.530929978s" totalImagesPullingTime="900.435102ms" totalInitContainerRuntime="71.653514ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:44.529315268 +0000 UTC m=+278.473923014" watchObservedRunningTime="2026-07-09 14:00:44.530929978 +0000 UTC m=+278.475537723" Jul 09 14:00:44.639962 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.639915 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:44.882328 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.882241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:44.978796 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:44.978759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:45.036879 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:45.036843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:46.362890 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.362804 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn"] Jul 09 14:00:46.363247 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.363138 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:46.365761 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.365746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:46.369516 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.369491 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 14:00:46.369633 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.369540 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2q726\"" Jul 09 14:00:46.376064 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.376039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn"] Jul 09 14:00:46.423038 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.423001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8nw\" (UniqueName: \"kubernetes.io/projected/4dd010ab-2ca8-40cf-a269-dd839682c4d5-kube-api-access-7t8nw\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:46.423197 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.423047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd010ab-2ca8-40cf-a269-dd839682c4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:46.485724 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.485688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:46.520120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.520091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"454dacf10cfee6b6e1389744e03c88c1e5b70dc083ef1243ff341e1625f6fc16"} Jul 09 14:00:46.520278 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.520154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"9d079b674cd8607b014f391493fcc8fc3a3f1975f96ee08dbf20cedbefc8e6ad"} Jul 09 14:00:46.520278 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.520183 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"e099d8fe42edd4dcb2f3298292390315e23cc6dbaa66fa2cb07cb4f867e772de"} Jul 09 14:00:46.524639 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.524611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8nw\" (UniqueName: \"kubernetes.io/projected/4dd010ab-2ca8-40cf-a269-dd839682c4d5-kube-api-access-7t8nw\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:46.524765 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.524665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd010ab-2ca8-40cf-a269-dd839682c4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:46.524816 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:46.524801 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 14:00:46.524886 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:46.524869 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dd010ab-2ca8-40cf-a269-dd839682c4d5-monitoring-plugin-cert podName:4dd010ab-2ca8-40cf-a269-dd839682c4d5 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:47.024845196 +0000 UTC m=+280.969452921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4dd010ab-2ca8-40cf-a269-dd839682c4d5-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-bb5gn" (UID: "4dd010ab-2ca8-40cf-a269-dd839682c4d5") : secret "monitoring-plugin-cert" not found Jul 09 14:00:46.537499 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.537470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8nw\" (UniqueName: \"kubernetes.io/projected/4dd010ab-2ca8-40cf-a269-dd839682c4d5-kube-api-access-7t8nw\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:46.590499 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.590462 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:46.703768 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:46.703678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:47.030049 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.029995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd010ab-2ca8-40cf-a269-dd839682c4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:47.033169 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.033144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd010ab-2ca8-40cf-a269-dd839682c4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bb5gn\" (UID: \"4dd010ab-2ca8-40cf-a269-dd839682c4d5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:47.275661 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.275626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:47.409210 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.409186 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn"] Jul 09 14:00:47.411775 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:47.411746 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd010ab_2ca8_40cf_a269_dd839682c4d5.slice/crio-06f72f0511407a960ef28aef3c99465696149ef86dc1476f0a814fac7311af8c WatchSource:0}: Error finding container 06f72f0511407a960ef28aef3c99465696149ef86dc1476f0a814fac7311af8c: Status 404 returned error can't find the container with id 06f72f0511407a960ef28aef3c99465696149ef86dc1476f0a814fac7311af8c Jul 09 14:00:47.527036 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.526955 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"9c0544c050ed0b6e82ef8e21b3120511a297c66c71f74bce2bb11b649374a618"} Jul 09 14:00:47.527036 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.527034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"0e7e94bead7423272004ad9b7529d75197f97a6c949df70476b4b89fed4a6e35"} Jul 09 14:00:47.527278 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.527070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" event={"ID":"8428a350-eda3-4be0-b289-5498cc6dea00","Type":"ContainerStarted","Data":"4f19ab9eb2216794c29d2d99c6aad42702f74c5f39894b319a37c83b42a76738"} Jul 09 14:00:47.527278 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.527114 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:47.528139 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.528116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" event={"ID":"4dd010ab-2ca8-40cf-a269-dd839682c4d5","Type":"ContainerStarted","Data":"06f72f0511407a960ef28aef3c99465696149ef86dc1476f0a814fac7311af8c"} Jul 09 14:00:47.555626 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.555584 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" podStartSLOduration=1.9126794390000001 podStartE2EDuration="4.555570168s" totalImagesPullingTime="2.642890729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:47.553475607 +0000 UTC m=+281.498083355" watchObservedRunningTime="2026-07-09 14:00:47.555570168 +0000 UTC m=+281.500177913" Jul 09 14:00:47.655959 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.655931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:47.861938 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.861836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:47.960168 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:47.960138 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:48.203265 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:48.203171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:48.540006 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:48.539972 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:49.539906 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:49.539870 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" event={"ID":"4dd010ab-2ca8-40cf-a269-dd839682c4d5","Type":"ContainerStarted","Data":"bb6748126d9d7f253f378a7a8e7d1e014f8b6e787126d327c95f9b3c5132ad09"} Jul 09 14:00:49.540070 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:49.540028 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:49.544709 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:49.544688 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" Jul 09 14:00:49.558637 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:49.558581 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bb5gn" podStartSLOduration=2.1745122869999998 podStartE2EDuration="3.558561866s" totalImagesPullingTime="1.384049579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:49.557786255 +0000 UTC m=+283.502394004" watchObservedRunningTime="2026-07-09 14:00:49.558561866 +0000 UTC m=+283.503169611" Jul 09 14:00:50.157955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:50.157923 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:51.600291 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:51.600234 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:51.695076 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:51.695040 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:51.969346 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:51.969244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 14:00:51.971759 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:51.971732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9295001a-27e2-4430-b2e7-b3a1d900a1d1-metrics-tls\") pod \"dns-default-ktr6t\" (UID: \"9295001a-27e2-4430-b2e7-b3a1d900a1d1\") " pod="openshift-dns/dns-default-ktr6t" Jul 09 14:00:52.143935 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.143903 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dkvmm\"" Jul 09 14:00:52.151298 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.151277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktr6t" Jul 09 14:00:52.290883 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.290801 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ktr6t"] Jul 09 14:00:52.294902 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:52.294877 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9295001a_27e2_4430_b2e7_b3a1d900a1d1.slice/crio-b275049b775699458c59ecc8cc20f980ffe932f0c9ece5a029c620329ee1eeb2 WatchSource:0}: Error finding container b275049b775699458c59ecc8cc20f980ffe932f0c9ece5a029c620329ee1eeb2: Status 404 returned error can't find the container with id b275049b775699458c59ecc8cc20f980ffe932f0c9ece5a029c620329ee1eeb2 Jul 09 14:00:52.467716 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.467690 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fc886cdd-cd9kx" Jul 09 14:00:52.550996 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.550962 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ktr6t" event={"ID":"9295001a-27e2-4430-b2e7-b3a1d900a1d1","Type":"ContainerStarted","Data":"b275049b775699458c59ecc8cc20f980ffe932f0c9ece5a029c620329ee1eeb2"} Jul 09 14:00:52.697519 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.697466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:52.794038 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:52.794002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:53.542593 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:53.542568 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c7d4bbb4f-vjxk7" Jul 09 14:00:54.391283 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:54.391248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:54.465788 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:54.465703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:54.559642 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:54.559608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ktr6t" event={"ID":"9295001a-27e2-4430-b2e7-b3a1d900a1d1","Type":"ContainerStarted","Data":"bfbc7edda7a840dae359a202855d235184ad7977ff26f86d6137d56e6af6d4a8"} Jul 09 14:00:54.559811 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:54.559693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ktr6t" event={"ID":"9295001a-27e2-4430-b2e7-b3a1d900a1d1","Type":"ContainerStarted","Data":"a309ddc1509ce2231839a96397a6a7b4159cfaf905132401c5962fab2a86aefa"} Jul 09 14:00:54.559811 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:54.559723 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ktr6t" Jul 09 14:00:54.579611 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:54.579566 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ktr6t" podStartSLOduration=251.721968194 podStartE2EDuration="4m13.579550986s" totalImagesPullingTime="1.857582792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:54.577748099 +0000 UTC m=+288.522355844" watchObservedRunningTime="2026-07-09 14:00:54.579550986 +0000 UTC m=+288.524158731" Jul 09 14:00:55.173628 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.173581 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" podUID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" containerName="registry" containerID="cri-o://b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5" gracePeriod=30 Jul 09 14:00:55.423737 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.423678 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:55.500534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500506 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-trusted-ca\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500706 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500543 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-bound-sa-token\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500706 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500567 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-ca-trust-extracted\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500706 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500588 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-certificates\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500863 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500726 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rztj2\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-kube-api-access-rztj2\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500863 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500780 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-image-registry-private-configuration\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500870 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-installation-pull-secrets\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.500955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.500902 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") pod \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\" (UID: \"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7\") " Jul 09 14:00:55.501057 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.501003 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:00:55.501105 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.501053 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:00:55.501192 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.501173 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-certificates\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.501240 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.501200 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-trusted-ca\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.503393 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.503367 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:00:55.503562 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.503537 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:00:55.503684 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.503661 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:00:55.503883 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.503857 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:00:55.503883 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.503872 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-kube-api-access-rztj2" (OuterVolumeSpecName: "kube-api-access-rztj2") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "kube-api-access-rztj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:00:55.510020 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.509992 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" (UID: "dd3bdf4c-a791-44b2-be54-d9f5eb988ec7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:00:55.564659 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.564623 2559 generic.go:356] "Generic (PLEG): container finished" podID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" containerID="b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5" exitCode=0 Jul 09 14:00:55.564839 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.564676 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" Jul 09 14:00:55.564839 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.564705 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" event={"ID":"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7","Type":"ContainerDied","Data":"b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5"} Jul 09 14:00:55.564839 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.564756 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7649b6fdf6-6mg2t" event={"ID":"dd3bdf4c-a791-44b2-be54-d9f5eb988ec7","Type":"ContainerDied","Data":"14a402dff0bff34c386e5afe710a8c121a38bc1fda0511cb7a23b67f37ec965d"} Jul 09 14:00:55.564839 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.564783 2559 scope.go:117] "RemoveContainer" containerID="b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5" Jul 09 14:00:55.573995 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.573979 2559 scope.go:117] "RemoveContainer" containerID="b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5" Jul 09 14:00:55.574260 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:00:55.574238 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5\": container with ID starting with b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5 not found: ID does not exist" containerID="b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5" Jul 09 14:00:55.574299 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.574270 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5"} err="failed to get container status \"b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5\": rpc error: code = NotFound desc = could not find container \"b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5\": container with ID starting with b19677c5e564ccb845ecb6f6e1f61e730f7fdf945630c36f788c12cbd1db5df5 not found: ID does not exist" Jul 09 14:00:55.588171 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.588139 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7649b6fdf6-6mg2t"] Jul 09 14:00:55.594087 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.594060 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7649b6fdf6-6mg2t"] Jul 09 14:00:55.601967 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.601944 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-image-registry-private-configuration\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.602065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.601969 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-installation-pull-secrets\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.602065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.601979 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-registry-tls\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.602065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.601990 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-bound-sa-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.602065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.602001 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-ca-trust-extracted\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:55.602065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:55.602010 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rztj2\" (UniqueName: \"kubernetes.io/projected/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7-kube-api-access-rztj2\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:00:56.642372 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:56.642338 2559 scope.go:117] "RemoveContainer" containerID="fb6e71328a3e4424c78bb06d3cb3e39cc4a098ae89ac56a305e3093230543eb1" Jul 09 14:00:56.645063 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:56.645042 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" path="/var/lib/kubelet/pods/dd3bdf4c-a791-44b2-be54-d9f5eb988ec7/volumes" Jul 09 14:00:57.484703 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.484672 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-k75n5"] Jul 09 14:00:57.484965 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.484954 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" containerName="registry" Jul 09 14:00:57.485015 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.484968 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" containerName="registry" Jul 09 14:00:57.485052 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.485016 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd3bdf4c-a791-44b2-be54-d9f5eb988ec7" containerName="registry" Jul 09 14:00:57.491845 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.491817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:00:57.494778 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.494749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sqtxn\"" Jul 09 14:00:57.495005 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.494988 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:00:57.495305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.495287 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:00:57.502428 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.502405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:57.505418 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.505399 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-k75n5"] Jul 09 14:00:57.576747 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.576723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:00:57.576887 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.576812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" event={"ID":"34506a96-b741-46b1-b3ad-f15dbc4806e2","Type":"ContainerStarted","Data":"e37811a977bc7e1e83a283532cb83830ad316679c322c6e0cd60005b6e61a4ea"} Jul 09 14:00:57.577099 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.577081 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:57.581589 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.581567 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" Jul 09 14:00:57.586306 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.586282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:57.594521 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.594483 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-4nqmg" podStartSLOduration=54.118689092 podStartE2EDuration="57.594469658s" totalImagesPullingTime="3.475780566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:57.593115104 +0000 UTC m=+291.537722850" watchObservedRunningTime="2026-07-09 14:00:57.594469658 +0000 UTC m=+291.539077405" Jul 09 14:00:57.617974 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.617950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d76r2\" (UniqueName: \"kubernetes.io/projected/3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2-kube-api-access-d76r2\") pod \"downloads-685bfb5f64-k75n5\" (UID: \"3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2\") " pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:00:57.688020 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.687988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:57.719373 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.719338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d76r2\" (UniqueName: \"kubernetes.io/projected/3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2-kube-api-access-d76r2\") pod \"downloads-685bfb5f64-k75n5\" (UID: \"3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2\") " pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:00:57.728629 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.728605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d76r2\" (UniqueName: \"kubernetes.io/projected/3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2-kube-api-access-d76r2\") pod \"downloads-685bfb5f64-k75n5\" (UID: \"3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2\") " pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:00:57.787368 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.787339 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:57.801295 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.801270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:00:57.928380 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:57.928361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-k75n5"] Jul 09 14:00:57.930786 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:00:57.930762 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce4f7d8_e0bf_49a7_ba94_a098fbe5b1c2.slice/crio-eaa8feb2e235341f21f8593898d6ab71dfad9aa580599525f127720672a9774c WatchSource:0}: Error finding container eaa8feb2e235341f21f8593898d6ab71dfad9aa580599525f127720672a9774c: Status 404 returned error can't find the container with id eaa8feb2e235341f21f8593898d6ab71dfad9aa580599525f127720672a9774c Jul 09 14:00:58.178471 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:58.178362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:58.248669 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:58.248637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:58.570498 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:58.570463 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:58.581364 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:58.581336 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-k75n5" event={"ID":"3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2","Type":"ContainerStarted","Data":"eaa8feb2e235341f21f8593898d6ab71dfad9aa580599525f127720672a9774c"} Jul 09 14:00:58.627403 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:58.627374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:58.993709 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:58.993618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.055132 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:59.055084 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.169876 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:59.169837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.376066 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:59.376030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.476709 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:00:59.476672 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:00.820464 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:00.820409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:00.878516 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:00.878488 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:04.567939 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:04.567909 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ktr6t" Jul 09 14:01:06.488860 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:06.488836 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:01:06.489728 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:06.489708 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:01:06.502160 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:06.502129 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:01:09.380166 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:09.380116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:09.441327 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:09.441286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:12.993182 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:12.993145 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:13.537915 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:13.537878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:13.750251 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:13.750215 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:13.850761 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:13.850667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:15.400753 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.400719 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fc994bfb-n6srd"] Jul 09 14:01:15.404325 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.404299 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.407013 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.406989 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:01:15.408199 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.408176 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:01:15.408199 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.408211 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p6gtz\"" Jul 09 14:01:15.408399 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.408238 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:01:15.408581 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.408409 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:01:15.408581 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.408509 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:01:15.413044 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.413024 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:01:15.417949 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.417919 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fc994bfb-n6srd"] Jul 09 14:01:15.470460 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-service-ca\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.470641 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-oauth-serving-cert\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.470641 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-serving-cert\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.470641 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-trusted-ca-bundle\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.470799 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdgqm\" (UniqueName: \"kubernetes.io/projected/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-kube-api-access-gdgqm\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.470799 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-config\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.470902 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.470797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-oauth-config\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572213 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-service-ca\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572398 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-oauth-serving-cert\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572398 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-serving-cert\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572615 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-trusted-ca-bundle\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572615 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdgqm\" (UniqueName: \"kubernetes.io/projected/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-kube-api-access-gdgqm\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572712 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-config\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.572712 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.572665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-oauth-config\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.573164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.573104 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-oauth-serving-cert\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.573164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.573128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-service-ca\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.573334 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.573293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-config\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.573389 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.573342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-trusted-ca-bundle\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.575379 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.575355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-serving-cert\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.575510 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.575482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-oauth-config\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.582075 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.582051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdgqm\" (UniqueName: \"kubernetes.io/projected/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-kube-api-access-gdgqm\") pod \"console-57fc994bfb-n6srd\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:15.716575 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:15.716489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:16.594728 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:16.594682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:18.150051 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.150016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fc994bfb-n6srd"] Jul 09 14:01:18.152283 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:01:18.152247 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ab5c1a_5e2a_4646_ab20_fcb60ce91d3d.slice/crio-4a4ef02e95e4b51c6b6f01bb5ea8a8a80faf40d20ea5761004c22ff18d8e008f WatchSource:0}: Error finding container 4a4ef02e95e4b51c6b6f01bb5ea8a8a80faf40d20ea5761004c22ff18d8e008f: Status 404 returned error can't find the container with id 4a4ef02e95e4b51c6b6f01bb5ea8a8a80faf40d20ea5761004c22ff18d8e008f Jul 09 14:01:18.154605 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.154584 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:01:18.672881 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.672777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc994bfb-n6srd" event={"ID":"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d","Type":"ContainerStarted","Data":"4a4ef02e95e4b51c6b6f01bb5ea8a8a80faf40d20ea5761004c22ff18d8e008f"} Jul 09 14:01:18.675080 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.674914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-k75n5" event={"ID":"3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2","Type":"ContainerStarted","Data":"a79d717bf3c1090880f2e45afe8c08558a653787cef3cda4694708995043d5e4"} Jul 09 14:01:18.675729 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.675703 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:01:18.691561 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.691538 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-k75n5" Jul 09 14:01:18.696230 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:18.696177 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-k75n5" podStartSLOduration=1.533040371 podStartE2EDuration="21.696157228s" totalImagesPullingTime="20.163116857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:01:18.694789561 +0000 UTC m=+312.639397309" watchObservedRunningTime="2026-07-09 14:01:18.696157228 +0000 UTC m=+312.640764974" Jul 09 14:01:19.799493 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:19.799420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:19.863714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:19.863675 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:20.687514 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:20.687467 2559 generic.go:356] "Generic (PLEG): container finished" podID="0eb56b35-896d-47d4-b268-fd3e99165c03" containerID="e3eccddf9cef83df97d414aabd56c74ac48c132d5aa08fa0f5ff2ed940ea310d" exitCode=0 Jul 09 14:01:20.688350 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:20.688071 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" event={"ID":"0eb56b35-896d-47d4-b268-fd3e99165c03","Type":"ContainerDied","Data":"e3eccddf9cef83df97d414aabd56c74ac48c132d5aa08fa0f5ff2ed940ea310d"} Jul 09 14:01:20.688980 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:20.688614 2559 scope.go:117] "RemoveContainer" containerID="e3eccddf9cef83df97d414aabd56c74ac48c132d5aa08fa0f5ff2ed940ea310d" Jul 09 14:01:21.695311 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:21.695272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6blp4" event={"ID":"0eb56b35-896d-47d4-b268-fd3e99165c03","Type":"ContainerStarted","Data":"cc09a291f0225fa63d9da136d7365f16521eb202dac995ce42bd31f3c03cef25"} Jul 09 14:01:22.218038 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:22.217953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:22.287663 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:22.287628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:22.701779 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:22.701741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc994bfb-n6srd" event={"ID":"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d","Type":"ContainerStarted","Data":"b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041"} Jul 09 14:01:22.727190 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:22.727140 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fc994bfb-n6srd" podStartSLOduration=4.026470361 podStartE2EDuration="7.727124528s" totalImagesPullingTime="3.700654167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:01:22.725619944 +0000 UTC m=+316.670227690" watchObservedRunningTime="2026-07-09 14:01:22.727124528 +0000 UTC m=+316.671732284" Jul 09 14:01:22.727602 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:22.727584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:22.825828 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:22.825794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:24.376481 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:24.376424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:24.434821 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:24.434784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:25.717705 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:25.717668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:25.718157 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:25.717750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:25.723303 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:25.723270 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:26.724201 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:26.724166 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:01:26.898638 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:26.898604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:30.737290 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:30.737252 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2805060-7d9d-4076-bed7-99c5ed5f1325" containerID="7074db0b6f5892fed59bf1eb18a1f138ee6a587bf39e0d1d3a823fe3f5082eb3" exitCode=0 Jul 09 14:01:30.737722 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:30.737306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" event={"ID":"b2805060-7d9d-4076-bed7-99c5ed5f1325","Type":"ContainerDied","Data":"7074db0b6f5892fed59bf1eb18a1f138ee6a587bf39e0d1d3a823fe3f5082eb3"} Jul 09 14:01:30.737722 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:30.737653 2559 scope.go:117] "RemoveContainer" containerID="7074db0b6f5892fed59bf1eb18a1f138ee6a587bf39e0d1d3a823fe3f5082eb3" Jul 09 14:01:31.742658 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:31.742620 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wkswv" event={"ID":"b2805060-7d9d-4076-bed7-99c5ed5f1325","Type":"ContainerStarted","Data":"ea7d36041f7f2fe20e19ac6480eaaf824ef590e4d1492fbd54908870153381ce"} Jul 09 14:01:53.018725 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:53.018683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:53.095693 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:53.095656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:57.841807 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:57.841719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:57.901315 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:01:57.901281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:05.043905 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:05.043873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:05.146659 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:05.146623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:05.693604 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:05.693546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:05.795300 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:05.795256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:08.238617 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:08.238581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:09.750244 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:09.750212 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:09.810197 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:09.810163 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:16.050258 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:16.050222 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fc994bfb-n6srd"] Jul 09 14:02:16.956935 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:16.956900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:17.017258 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:17.017221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:24.434358 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:24.434315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:24.529137 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:24.529106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:41.071744 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.071680 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57fc994bfb-n6srd" podUID="04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" containerName="console" containerID="cri-o://b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041" gracePeriod=15 Jul 09 14:02:41.309730 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.309700 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:02:41.388973 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.388873 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-service-ca\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.388973 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.388915 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-trusted-ca-bundle\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.388973 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.388948 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-config\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.389305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389130 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-serving-cert\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.389305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389179 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-oauth-config\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.389305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389242 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdgqm\" (UniqueName: \"kubernetes.io/projected/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-kube-api-access-gdgqm\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.389305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389274 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-oauth-serving-cert\") pod \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\" (UID: \"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d\") " Jul 09 14:02:41.389305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389272 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:41.389570 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-config" (OuterVolumeSpecName: "console-config") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:41.389570 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389390 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:41.389736 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389717 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:41.389801 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389727 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-config\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:41.389801 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389751 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-service-ca\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:41.389801 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.389761 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-trusted-ca-bundle\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:41.391556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.391530 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:02:41.391614 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.391591 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:02:41.391688 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.391664 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-kube-api-access-gdgqm" (OuterVolumeSpecName: "kube-api-access-gdgqm") pod "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" (UID: "04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d"). InnerVolumeSpecName "kube-api-access-gdgqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:02:41.491029 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.490991 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-serving-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:41.491029 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.491023 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-console-oauth-config\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:41.491029 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.491035 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdgqm\" (UniqueName: \"kubernetes.io/projected/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-kube-api-access-gdgqm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:41.491261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:41.491047 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d-oauth-serving-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:02:42.016233 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.016193 2559 generic.go:356] "Generic (PLEG): container finished" podID="04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" containerID="b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041" exitCode=0 Jul 09 14:02:42.016409 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.016241 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc994bfb-n6srd" Jul 09 14:02:42.016409 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.016265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc994bfb-n6srd" event={"ID":"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d","Type":"ContainerDied","Data":"b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041"} Jul 09 14:02:42.016409 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.016315 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc994bfb-n6srd" event={"ID":"04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d","Type":"ContainerDied","Data":"4a4ef02e95e4b51c6b6f01bb5ea8a8a80faf40d20ea5761004c22ff18d8e008f"} Jul 09 14:02:42.016409 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.016342 2559 scope.go:117] "RemoveContainer" containerID="b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041" Jul 09 14:02:42.025019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.025000 2559 scope.go:117] "RemoveContainer" containerID="b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041" Jul 09 14:02:42.025265 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:02:42.025244 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041\": container with ID starting with b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041 not found: ID does not exist" containerID="b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041" Jul 09 14:02:42.025328 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.025273 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041"} err="failed to get container status \"b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041\": rpc error: code = NotFound desc = could not find container \"b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041\": container with ID starting with b7d8815e65bb51d08882ad05ceeadce1f9ee347915fcc067a14da430289aa041 not found: ID does not exist" Jul 09 14:02:42.040772 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.040749 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fc994bfb-n6srd"] Jul 09 14:02:42.043725 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.043704 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fc994bfb-n6srd"] Jul 09 14:02:42.645239 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.645209 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" path="/var/lib/kubelet/pods/04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d/volumes" Jul 09 14:02:42.978624 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:42.978533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:43.064095 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:02:43.064061 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:01.652469 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:01.652419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:01.721795 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:01.721764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:14.016602 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:14.016562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:14.132810 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:14.132777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:47.091271 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:47.091234 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:48.015743 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:48.015712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:51.442360 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:51.442322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:51.542983 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:51.542948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:53.356971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.356937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:53.503925 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.503891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:53.580054 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.580026 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xc542"] Jul 09 14:03:53.580326 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.580315 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" containerName="console" Jul 09 14:03:53.580386 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.580328 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" containerName="console" Jul 09 14:03:53.580386 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.580373 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ab5c1a-5e2a-4646-ab20-fcb60ce91d3d" containerName="console" Jul 09 14:03:53.582655 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.582640 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.585715 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.585694 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:03:53.587008 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.586983 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:03:53.587987 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.587965 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kb5k5\"" Jul 09 14:03:53.629404 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.629325 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xc542"] Jul 09 14:03:53.633387 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.633359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxm5\" (UniqueName: \"kubernetes.io/projected/bf1b06bd-8b79-4633-acee-651d0abfe2f8-kube-api-access-5jxm5\") pod \"cert-manager-webhook-6486ffd997-xc542\" (UID: \"bf1b06bd-8b79-4633-acee-651d0abfe2f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.633518 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.633424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1b06bd-8b79-4633-acee-651d0abfe2f8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xc542\" (UID: \"bf1b06bd-8b79-4633-acee-651d0abfe2f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.734660 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.734629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxm5\" (UniqueName: \"kubernetes.io/projected/bf1b06bd-8b79-4633-acee-651d0abfe2f8-kube-api-access-5jxm5\") pod \"cert-manager-webhook-6486ffd997-xc542\" (UID: \"bf1b06bd-8b79-4633-acee-651d0abfe2f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.734835 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.734679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1b06bd-8b79-4633-acee-651d0abfe2f8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xc542\" (UID: \"bf1b06bd-8b79-4633-acee-651d0abfe2f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.751495 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.751464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1b06bd-8b79-4633-acee-651d0abfe2f8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xc542\" (UID: \"bf1b06bd-8b79-4633-acee-651d0abfe2f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.751620 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.751598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxm5\" (UniqueName: \"kubernetes.io/projected/bf1b06bd-8b79-4633-acee-651d0abfe2f8-kube-api-access-5jxm5\") pod \"cert-manager-webhook-6486ffd997-xc542\" (UID: \"bf1b06bd-8b79-4633-acee-651d0abfe2f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.891769 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.891677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:53.959805 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:53.959779 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:54.065383 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:54.065352 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xc542"] Jul 09 14:03:54.070940 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:03:54.070914 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf1b06bd_8b79_4633_acee_651d0abfe2f8.slice/crio-918706700b01826de8622468c1634f3347baf5cd12a102d2837003d30336e9da WatchSource:0}: Error finding container 918706700b01826de8622468c1634f3347baf5cd12a102d2837003d30336e9da: Status 404 returned error can't find the container with id 918706700b01826de8622468c1634f3347baf5cd12a102d2837003d30336e9da Jul 09 14:03:54.195792 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:54.195679 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:54.288228 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:54.288194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" event={"ID":"bf1b06bd-8b79-4633-acee-651d0abfe2f8","Type":"ContainerStarted","Data":"918706700b01826de8622468c1634f3347baf5cd12a102d2837003d30336e9da"} Jul 09 14:03:55.738670 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:55.738616 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:56.164873 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:56.164837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:57.303018 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:57.302980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" event={"ID":"bf1b06bd-8b79-4633-acee-651d0abfe2f8","Type":"ContainerStarted","Data":"22cc726a95e1eb480e3ca6d40904791ed9400b903131e3e55ecf829b438179ed"} Jul 09 14:03:57.303404 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:57.303085 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:03:57.322012 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:57.321948 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" podStartSLOduration=1.292777816 podStartE2EDuration="4.321932561s" totalImagesPullingTime="3.029154745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:57.321025706 +0000 UTC m=+471.265633452" watchObservedRunningTime="2026-07-09 14:03:57.321932561 +0000 UTC m=+471.266540306" Jul 09 14:03:57.799590 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:57.799554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:57.902548 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:03:57.902510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:03.309309 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:03.309279 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xc542" Jul 09 14:04:03.340738 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:03.340686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:04.886476 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:04.886408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:04.988809 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:04.988773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:08.252747 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:08.252714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:08.324358 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:08.324330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:11.369913 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:11.369878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:11.469012 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:11.468981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.474184 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:15.474148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:16.147480 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:16.147427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:23.328462 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:23.328409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:25.044586 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:25.044553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:25.147713 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:25.147678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:25.658015 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:25.657976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:25.878248 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:25.878213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:25.991107 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:25.991015 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.013338 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.013306 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd"] Jul 09 14:04:26.023452 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.023422 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.026152 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.026132 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:04:26.026373 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.026359 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:04:26.026477 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.026396 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:04:26.026648 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.026631 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-djqn2\"" Jul 09 14:04:26.026748 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.026733 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:04:26.037164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.037141 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd"] Jul 09 14:04:26.199821 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.199793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64301805-e75c-4184-b03d-1e3a202b4caf-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.200178 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.199827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64301805-e75c-4184-b03d-1e3a202b4caf-manifests\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.200178 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.199847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nwg\" (UniqueName: \"kubernetes.io/projected/64301805-e75c-4184-b03d-1e3a202b4caf-kube-api-access-j4nwg\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.200178 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.199954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64301805-e75c-4184-b03d-1e3a202b4caf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.200178 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.199989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64301805-e75c-4184-b03d-1e3a202b4caf-tmp\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.215117 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.215085 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.300921 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.300886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64301805-e75c-4184-b03d-1e3a202b4caf-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.300921 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.300922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64301805-e75c-4184-b03d-1e3a202b4caf-manifests\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.301175 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.300943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nwg\" (UniqueName: \"kubernetes.io/projected/64301805-e75c-4184-b03d-1e3a202b4caf-kube-api-access-j4nwg\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.301175 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.301017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64301805-e75c-4184-b03d-1e3a202b4caf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.301175 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.301044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64301805-e75c-4184-b03d-1e3a202b4caf-tmp\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.301389 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.301366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64301805-e75c-4184-b03d-1e3a202b4caf-manifests\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.303576 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.303548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64301805-e75c-4184-b03d-1e3a202b4caf-tmp\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.303698 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.303661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64301805-e75c-4184-b03d-1e3a202b4caf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.303762 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.303738 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64301805-e75c-4184-b03d-1e3a202b4caf-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.310035 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.310005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nwg\" (UniqueName: \"kubernetes.io/projected/64301805-e75c-4184-b03d-1e3a202b4caf-kube-api-access-j4nwg\") pod \"opendatahub-operator-controller-manager-5d74b946fd-nzmvd\" (UID: \"64301805-e75c-4184-b03d-1e3a202b4caf\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.313072 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.313046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.333820 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.333791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:26.419386 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.419356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.474406 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.474372 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd"] Jul 09 14:04:26.477880 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:26.477843 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64301805_e75c_4184_b03d_1e3a202b4caf.slice/crio-c2d42338709ad746f3870761652015e4e5030220aea2d8005911bd0a2b49cd6e WatchSource:0}: Error finding container c2d42338709ad746f3870761652015e4e5030220aea2d8005911bd0a2b49cd6e: Status 404 returned error can't find the container with id c2d42338709ad746f3870761652015e4e5030220aea2d8005911bd0a2b49cd6e Jul 09 14:04:26.504782 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.504746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.583338 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.583243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.679262 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.679236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.782294 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:26.782253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:27.418753 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:27.418710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" event={"ID":"64301805-e75c-4184-b03d-1e3a202b4caf","Type":"ContainerStarted","Data":"c2d42338709ad746f3870761652015e4e5030220aea2d8005911bd0a2b49cd6e"} Jul 09 14:04:28.532809 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:28.532776 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:28.633079 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:28.633047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:30.435869 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:30.435834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" event={"ID":"64301805-e75c-4184-b03d-1e3a202b4caf","Type":"ContainerStarted","Data":"ed915a1bf137ef9b2a1a7789fd72ff19f1c666392543b8d9495a4458368518bf"} Jul 09 14:04:31.441002 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:31.440971 2559 generic.go:356] "Generic (PLEG): container finished" podID="64301805-e75c-4184-b03d-1e3a202b4caf" containerID="ed915a1bf137ef9b2a1a7789fd72ff19f1c666392543b8d9495a4458368518bf" exitCode=0 Jul 09 14:04:31.441397 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:31.441049 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" event={"ID":"64301805-e75c-4184-b03d-1e3a202b4caf","Type":"ContainerDied","Data":"ed915a1bf137ef9b2a1a7789fd72ff19f1c666392543b8d9495a4458368518bf"} Jul 09 14:04:32.447379 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:32.447287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" event={"ID":"64301805-e75c-4184-b03d-1e3a202b4caf","Type":"ContainerStarted","Data":"7a68da32d0b2dc221465c4343fa570077e003f2db6df50a1ce019c8fc93e2082"} Jul 09 14:04:32.447848 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:32.447406 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:32.477383 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:32.477326 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" podStartSLOduration=2.951647486 podStartE2EDuration="7.477309195s" totalImagesPullingTime="3.470028716s" totalInitContainerRuntime="1.055632993s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:32.47497981 +0000 UTC m=+506.419587555" watchObservedRunningTime="2026-07-09 14:04:32.477309195 +0000 UTC m=+506.421916939" Jul 09 14:04:42.093887 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:42.093851 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:42.205848 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:42.205789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:43.454755 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:43.454726 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d74b946fd-nzmvd" Jul 09 14:04:44.974004 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:44.973954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.118862 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.118820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.617643 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.617611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.652904 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.652868 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv"] Jul 09 14:04:45.661111 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.661087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.664639 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.664616 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:04:45.665239 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.665214 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 14:04:45.665550 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.665533 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 14:04:45.665942 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.665924 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:04:45.710207 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.710177 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv"] Jul 09 14:04:45.745362 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.745336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf815ed-0d80-4dc2-b027-6d906f1376bf-tls-certs\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.745515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.745381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cf815ed-0d80-4dc2-b027-6d906f1376bf-tmp\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.745515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.745480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjg7\" (UniqueName: \"kubernetes.io/projected/8cf815ed-0d80-4dc2-b027-6d906f1376bf-kube-api-access-chjg7\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.801769 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.801737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.846298 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.846266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chjg7\" (UniqueName: \"kubernetes.io/projected/8cf815ed-0d80-4dc2-b027-6d906f1376bf-kube-api-access-chjg7\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.846507 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.846309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf815ed-0d80-4dc2-b027-6d906f1376bf-tls-certs\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.846507 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.846436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cf815ed-0d80-4dc2-b027-6d906f1376bf-tmp\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.848766 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.848736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cf815ed-0d80-4dc2-b027-6d906f1376bf-tmp\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.848942 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.848925 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf815ed-0d80-4dc2-b027-6d906f1376bf-tls-certs\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.867401 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.867378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjg7\" (UniqueName: \"kubernetes.io/projected/8cf815ed-0d80-4dc2-b027-6d906f1376bf-kube-api-access-chjg7\") pod \"kube-auth-proxy-5f974f5cb9-22twv\" (UID: \"8cf815ed-0d80-4dc2-b027-6d906f1376bf\") " pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.872875 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.872819 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ptzrp"] Jul 09 14:04:45.876152 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.876136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:45.881521 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.881497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hfbmh\"" Jul 09 14:04:45.882295 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.882280 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 14:04:45.914391 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.914363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ptzrp"] Jul 09 14:04:45.947336 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.947299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzdn\" (UniqueName: \"kubernetes.io/projected/0833b610-37d9-43b8-8498-abdb43a044a0-kube-api-access-qpzdn\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:45.947336 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.947336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0833b610-37d9-43b8-8498-abdb43a044a0-cert\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:45.971570 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.971535 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" Jul 09 14:04:45.975398 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:45.975376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:46.048034 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.048004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzdn\" (UniqueName: \"kubernetes.io/projected/0833b610-37d9-43b8-8498-abdb43a044a0-kube-api-access-qpzdn\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:46.048199 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.048046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0833b610-37d9-43b8-8498-abdb43a044a0-cert\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:46.048263 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:04:46.048223 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 14:04:46.048318 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:04:46.048301 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0833b610-37d9-43b8-8498-abdb43a044a0-cert podName:0833b610-37d9-43b8-8498-abdb43a044a0 nodeName:}" failed. No retries permitted until 2026-07-09 14:04:46.54828387 +0000 UTC m=+520.492891593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0833b610-37d9-43b8-8498-abdb43a044a0-cert") pod "odh-model-controller-7998c67dc4-ptzrp" (UID: "0833b610-37d9-43b8-8498-abdb43a044a0") : secret "odh-model-controller-webhook-cert" not found Jul 09 14:04:46.067176 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.067145 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzdn\" (UniqueName: \"kubernetes.io/projected/0833b610-37d9-43b8-8498-abdb43a044a0-kube-api-access-qpzdn\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:46.143662 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.143586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv"] Jul 09 14:04:46.146622 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:46.146597 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf815ed_0d80_4dc2_b027_6d906f1376bf.slice/crio-978e250619c822049c001da3519c3f9439bcf71f5b9a72206d9841aa8670471b WatchSource:0}: Error finding container 978e250619c822049c001da3519c3f9439bcf71f5b9a72206d9841aa8670471b: Status 404 returned error can't find the container with id 978e250619c822049c001da3519c3f9439bcf71f5b9a72206d9841aa8670471b Jul 09 14:04:46.155649 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.155623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:46.458752 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.458668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:46.508148 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.508119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" event={"ID":"8cf815ed-0d80-4dc2-b027-6d906f1376bf","Type":"ContainerStarted","Data":"978e250619c822049c001da3519c3f9439bcf71f5b9a72206d9841aa8670471b"} Jul 09 14:04:46.551711 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.551688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0833b610-37d9-43b8-8498-abdb43a044a0-cert\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:46.554155 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.554128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0833b610-37d9-43b8-8498-abdb43a044a0-cert\") pod \"odh-model-controller-7998c67dc4-ptzrp\" (UID: \"0833b610-37d9-43b8-8498-abdb43a044a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:46.786223 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.786194 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:46.926733 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:46.926702 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ptzrp"] Jul 09 14:04:46.929678 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:46.929641 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0833b610_37d9_43b8_8498_abdb43a044a0.slice/crio-624cf444bbcb20f76aeb39092c05e44bb8f937576759cdc533db33dfc0d1f489 WatchSource:0}: Error finding container 624cf444bbcb20f76aeb39092c05e44bb8f937576759cdc533db33dfc0d1f489: Status 404 returned error can't find the container with id 624cf444bbcb20f76aeb39092c05e44bb8f937576759cdc533db33dfc0d1f489 Jul 09 14:04:47.276968 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.276934 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k7bs9"] Jul 09 14:04:47.281280 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.281264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.285526 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.285505 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 14:04:47.293703 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.293684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:47.319234 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.319201 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k7bs9"] Jul 09 14:04:47.356997 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.356969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/761db452-a7a0-4685-b656-e48eb8112826-tls-certs\") pod \"model-serving-api-54d89bd5fc-k7bs9\" (UID: \"761db452-a7a0-4685-b656-e48eb8112826\") " pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.357165 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.357103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgv8z\" (UniqueName: \"kubernetes.io/projected/761db452-a7a0-4685-b656-e48eb8112826-kube-api-access-vgv8z\") pod \"model-serving-api-54d89bd5fc-k7bs9\" (UID: \"761db452-a7a0-4685-b656-e48eb8112826\") " pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.458211 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.458175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/761db452-a7a0-4685-b656-e48eb8112826-tls-certs\") pod \"model-serving-api-54d89bd5fc-k7bs9\" (UID: \"761db452-a7a0-4685-b656-e48eb8112826\") " pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.458403 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.458287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgv8z\" (UniqueName: \"kubernetes.io/projected/761db452-a7a0-4685-b656-e48eb8112826-kube-api-access-vgv8z\") pod \"model-serving-api-54d89bd5fc-k7bs9\" (UID: \"761db452-a7a0-4685-b656-e48eb8112826\") " pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.461182 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.461153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/761db452-a7a0-4685-b656-e48eb8112826-tls-certs\") pod \"model-serving-api-54d89bd5fc-k7bs9\" (UID: \"761db452-a7a0-4685-b656-e48eb8112826\") " pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.473734 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.473712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgv8z\" (UniqueName: \"kubernetes.io/projected/761db452-a7a0-4685-b656-e48eb8112826-kube-api-access-vgv8z\") pod \"model-serving-api-54d89bd5fc-k7bs9\" (UID: \"761db452-a7a0-4685-b656-e48eb8112826\") " pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.503834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.503795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:47.515647 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.515595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" event={"ID":"0833b610-37d9-43b8-8498-abdb43a044a0","Type":"ContainerStarted","Data":"624cf444bbcb20f76aeb39092c05e44bb8f937576759cdc533db33dfc0d1f489"} Jul 09 14:04:47.591508 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.591409 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:47.781688 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.781654 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k7bs9"] Jul 09 14:04:47.787074 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:47.787030 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761db452_a7a0_4685_b656_e48eb8112826.slice/crio-4dccf498fb7bcb63d1c04fa6ce031df2954e3b060e2f1e1f3e46e9c650454b67 WatchSource:0}: Error finding container 4dccf498fb7bcb63d1c04fa6ce031df2954e3b060e2f1e1f3e46e9c650454b67: Status 404 returned error can't find the container with id 4dccf498fb7bcb63d1c04fa6ce031df2954e3b060e2f1e1f3e46e9c650454b67 Jul 09 14:04:47.869853 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.869731 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:47.879821 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.879782 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-grmr8"] Jul 09 14:04:47.883737 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.883711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.886923 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.886900 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-62mqj\"" Jul 09 14:04:47.887365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.887201 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:04:47.887365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.887221 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:04:47.887365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.887208 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:04:47.887609 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.887506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:04:47.899097 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.899067 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-grmr8"] Jul 09 14:04:47.950453 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.950400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:47.964642 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa42d6a-620f-4d44-9802-3821c950e132-local-certs\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.964642 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-istio-token\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.964856 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-cacerts\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.964856 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.964856 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.965026 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtcz\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-kube-api-access-5mtcz\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:47.965026 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:47.964921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065377 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtcz\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-kube-api-access-5mtcz\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa42d6a-620f-4d44-9802-3821c950e132-local-certs\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-istio-token\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-cacerts\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.065832 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.065610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.067605 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.066941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.069381 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.069351 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa42d6a-620f-4d44-9802-3821c950e132-local-certs\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.070910 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.070694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.070910 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.070873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-cacerts\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.071082 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.071059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.079865 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.079772 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-istio-token\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.083929 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.083890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtcz\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-kube-api-access-5mtcz\") pod \"istiod-openshift-gateway-7574459656-grmr8\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.198953 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.198870 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:48.521345 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:48.521313 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" event={"ID":"761db452-a7a0-4685-b656-e48eb8112826","Type":"ContainerStarted","Data":"4dccf498fb7bcb63d1c04fa6ce031df2954e3b060e2f1e1f3e46e9c650454b67"} Jul 09 14:04:49.084971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:49.084933 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-grmr8"] Jul 09 14:04:49.187044 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:49.186824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:49.693948 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:49.693916 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa42d6a_620f_4d44_9802_3821c950e132.slice/crio-d311bf7171ddac00bf674c3150f3fe9dc4944525f62cb5cdbd5c89d931630544 WatchSource:0}: Error finding container d311bf7171ddac00bf674c3150f3fe9dc4944525f62cb5cdbd5c89d931630544: Status 404 returned error can't find the container with id d311bf7171ddac00bf674c3150f3fe9dc4944525f62cb5cdbd5c89d931630544 Jul 09 14:04:50.534397 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:50.534355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" event={"ID":"caa42d6a-620f-4d44-9802-3821c950e132","Type":"ContainerStarted","Data":"d311bf7171ddac00bf674c3150f3fe9dc4944525f62cb5cdbd5c89d931630544"} Jul 09 14:04:51.544059 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.544014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" event={"ID":"8cf815ed-0d80-4dc2-b027-6d906f1376bf","Type":"ContainerStarted","Data":"38c0db6e4b3b6d4355d9f16ee279b48f7123b65dc9682b4d8ed7756bad3b96fb"} Jul 09 14:04:51.545779 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.545753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" event={"ID":"761db452-a7a0-4685-b656-e48eb8112826","Type":"ContainerStarted","Data":"6049c9e4425a78925377582c26d23788168b97b81d9dbe4145ac43fa49231b27"} Jul 09 14:04:51.545925 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.545833 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:04:51.547311 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.547284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" event={"ID":"0833b610-37d9-43b8-8498-abdb43a044a0","Type":"ContainerStarted","Data":"4e7daa5829076f83e0a00c0730828b1eddd50e7ffc351b61069057bab3ab10e1"} Jul 09 14:04:51.547474 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.547433 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:04:51.561758 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.561640 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f974f5cb9-22twv" podStartSLOduration=1.97509935 podStartE2EDuration="6.561625123s" totalImagesPullingTime="4.586525773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:51.561522418 +0000 UTC m=+525.506130163" watchObservedRunningTime="2026-07-09 14:04:51.561625123 +0000 UTC m=+525.506232869" Jul 09 14:04:51.579120 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.579071 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" podStartSLOduration=2.766134471 podStartE2EDuration="6.579051191s" totalImagesPullingTime="3.81291672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:51.577126506 +0000 UTC m=+525.521734261" watchObservedRunningTime="2026-07-09 14:04:51.579051191 +0000 UTC m=+525.523658937" Jul 09 14:04:51.594509 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:51.594464 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" podStartSLOduration=1.645642902 podStartE2EDuration="4.594421766s" totalImagesPullingTime="2.948778864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:51.593346304 +0000 UTC m=+525.537954051" watchObservedRunningTime="2026-07-09 14:04:51.594421766 +0000 UTC m=+525.539029512" Jul 09 14:04:52.202124 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:52.202086 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 14:04:52.202230 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:52.202155 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 14:04:52.554060 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:52.554024 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" event={"ID":"caa42d6a-620f-4d44-9802-3821c950e132","Type":"ContainerStarted","Data":"95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93"} Jul 09 14:04:52.554588 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:52.554205 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:53.561313 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:53.561281 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-grmr8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 14:04:53.561732 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:53.561340 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" podUID="caa42d6a-620f-4d44-9802-3821c950e132" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:04:53.576751 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:53.576701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:53.791995 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:53.791960 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:54.088928 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.088892 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:54.332248 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.332209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:54.517150 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.517083 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" podStartSLOduration=5.01119741 podStartE2EDuration="7.517063074s" totalImagesPullingTime="2.505865664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:52.598319161 +0000 UTC m=+526.542926905" watchObservedRunningTime="2026-07-09 14:04:54.517063074 +0000 UTC m=+528.461670859" Jul 09 14:04:54.517813 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.517791 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd"] Jul 09 14:04:54.521339 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.521311 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.532979 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.532957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd"] Jul 09 14:04:54.535056 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.535035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:54.633859 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.633820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2001523-c366-427d-b82a-cadcffc6787a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.634261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.633880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.634261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.633956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.634261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.633991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2001523-c366-427d-b82a-cadcffc6787a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.634261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.634052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2001523-c366-427d-b82a-cadcffc6787a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.634261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.634085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.634261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.634100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrtm\" (UniqueName: \"kubernetes.io/projected/c2001523-c366-427d-b82a-cadcffc6787a-kube-api-access-qmrtm\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735137 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735137 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2001523-c366-427d-b82a-cadcffc6787a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735371 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2001523-c366-427d-b82a-cadcffc6787a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735371 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735521 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrtm\" (UniqueName: \"kubernetes.io/projected/c2001523-c366-427d-b82a-cadcffc6787a-kube-api-access-qmrtm\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735583 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2001523-c366-427d-b82a-cadcffc6787a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.735638 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.735587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.736074 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.736049 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2001523-c366-427d-b82a-cadcffc6787a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.737638 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.737604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2001523-c366-427d-b82a-cadcffc6787a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.737769 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.737750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.737863 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.737842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.738061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.738040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2001523-c366-427d-b82a-cadcffc6787a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.758577 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.758541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrtm\" (UniqueName: \"kubernetes.io/projected/c2001523-c366-427d-b82a-cadcffc6787a-kube-api-access-qmrtm\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.760256 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.760229 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2001523-c366-427d-b82a-cadcffc6787a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zv7fd\" (UID: \"c2001523-c366-427d-b82a-cadcffc6787a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.830875 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.830794 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:54.982366 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.982322 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd"] Jul 09 14:04:54.985183 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:54.985151 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2001523_c366_427d_b82a_cadcffc6787a.slice/crio-03201953f4bf1ca4a22917e4ac4376f44082155836be1f71642f2692f7d0e4fc WatchSource:0}: Error finding container 03201953f4bf1ca4a22917e4ac4376f44082155836be1f71642f2692f7d0e4fc: Status 404 returned error can't find the container with id 03201953f4bf1ca4a22917e4ac4376f44082155836be1f71642f2692f7d0e4fc Jul 09 14:04:54.988141 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.988104 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 14:04:54.988235 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:54.988169 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 14:04:55.570085 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:55.570053 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" event={"ID":"c2001523-c366-427d-b82a-cadcffc6787a","Type":"ContainerStarted","Data":"47a6d2dc1bf06cb2aae6db38a6753253a69872605365fb8f8739de01faddc2d8"} Jul 09 14:04:55.570265 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:55.570106 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" event={"ID":"c2001523-c366-427d-b82a-cadcffc6787a","Type":"ContainerStarted","Data":"03201953f4bf1ca4a22917e4ac4376f44082155836be1f71642f2692f7d0e4fc"} Jul 09 14:04:55.570265 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:55.570130 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:55.596975 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:55.596923 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" podStartSLOduration=1.5969051300000001 podStartE2EDuration="1.59690513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:55.594967499 +0000 UTC m=+529.539575245" watchObservedRunningTime="2026-07-09 14:04:55.59690513 +0000 UTC m=+529.541512875" Jul 09 14:04:56.560687 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:56.560609 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:56.575941 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:56.575915 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zv7fd" Jul 09 14:04:56.681515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:56.681480 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-grmr8"] Jul 09 14:04:56.681672 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:56.681653 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" podUID="caa42d6a-620f-4d44-9802-3821c950e132" containerName="discovery" containerID="cri-o://95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93" gracePeriod=30 Jul 09 14:04:56.936422 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:56.936398 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:57.053929 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.053901 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa42d6a-620f-4d44-9802-3821c950e132-local-certs\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.053929 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.053936 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mtcz\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-kube-api-access-5mtcz\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.054142 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.053967 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-kubeconfig\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.054142 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.054020 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-cacerts\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.054142 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.054081 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-istio-token\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.054142 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.054115 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-ca-configmap\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.054330 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.054145 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-dns-cert\") pod \"caa42d6a-620f-4d44-9802-3821c950e132\" (UID: \"caa42d6a-620f-4d44-9802-3821c950e132\") " Jul 09 14:04:57.054612 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.054577 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:04:57.056731 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.056690 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa42d6a-620f-4d44-9802-3821c950e132-local-certs" (OuterVolumeSpecName: "local-certs") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:04:57.056847 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.056734 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:04:57.057030 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.056985 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:04:57.057030 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.056992 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-istio-token" (OuterVolumeSpecName: "istio-token") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:04:57.057030 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.057002 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-kube-api-access-5mtcz" (OuterVolumeSpecName: "kube-api-access-5mtcz") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "kube-api-access-5mtcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:04:57.057422 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.057398 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-cacerts" (OuterVolumeSpecName: "cacerts") pod "caa42d6a-620f-4d44-9802-3821c950e132" (UID: "caa42d6a-620f-4d44-9802-3821c950e132"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:04:57.155019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.154938 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.155019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.154969 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-ca-configmap\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.155019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.154984 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-csr-dns-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.155019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.154996 2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa42d6a-620f-4d44-9802-3821c950e132-local-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.155019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.155008 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mtcz\" (UniqueName: \"kubernetes.io/projected/caa42d6a-620f-4d44-9802-3821c950e132-kube-api-access-5mtcz\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.155019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.155020 2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-istio-kubeconfig\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.155312 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.155032 2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/caa42d6a-620f-4d44-9802-3821c950e132-cacerts\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:57.579730 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.579699 2559 generic.go:356] "Generic (PLEG): container finished" podID="caa42d6a-620f-4d44-9802-3821c950e132" containerID="95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93" exitCode=0 Jul 09 14:04:57.580189 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.579750 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" Jul 09 14:04:57.580189 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.579786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" event={"ID":"caa42d6a-620f-4d44-9802-3821c950e132","Type":"ContainerDied","Data":"95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93"} Jul 09 14:04:57.580189 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.579882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-grmr8" event={"ID":"caa42d6a-620f-4d44-9802-3821c950e132","Type":"ContainerDied","Data":"d311bf7171ddac00bf674c3150f3fe9dc4944525f62cb5cdbd5c89d931630544"} Jul 09 14:04:57.580189 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.579913 2559 scope.go:117] "RemoveContainer" containerID="95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93" Jul 09 14:04:57.589987 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.589963 2559 scope.go:117] "RemoveContainer" containerID="95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93" Jul 09 14:04:57.590273 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:04:57.590254 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93\": container with ID starting with 95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93 not found: ID does not exist" containerID="95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93" Jul 09 14:04:57.590347 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.590281 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93"} err="failed to get container status \"95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93\": rpc error: code = NotFound desc = could not find container \"95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93\": container with ID starting with 95d1eaa305cd8d423faf58e1c1e89db09aae9d93cae9f2dc5cc8a014c1762d93 not found: ID does not exist" Jul 09 14:04:57.627494 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.627429 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-grmr8"] Jul 09 14:04:57.636253 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.636218 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-grmr8"] Jul 09 14:04:57.689117 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.689049 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:57.837139 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.837045 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-47rnb"] Jul 09 14:04:57.837515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.837485 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa42d6a-620f-4d44-9802-3821c950e132" containerName="discovery" Jul 09 14:04:57.837515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.837507 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa42d6a-620f-4d44-9802-3821c950e132" containerName="discovery" Jul 09 14:04:57.837680 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.837602 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="caa42d6a-620f-4d44-9802-3821c950e132" containerName="discovery" Jul 09 14:04:57.840666 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.840645 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:57.844057 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.844032 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 14:04:57.844949 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.844928 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9xdw6\"" Jul 09 14:04:57.878731 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.878701 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-47rnb"] Jul 09 14:04:57.962746 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.962713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmdg7\" (UniqueName: \"kubernetes.io/projected/847d128f-9bc6-4727-a5be-298e31d5cb76-kube-api-access-jmdg7\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:57.962914 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:57.962764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/847d128f-9bc6-4727-a5be-298e31d5cb76-cert\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.063625 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.063587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmdg7\" (UniqueName: \"kubernetes.io/projected/847d128f-9bc6-4727-a5be-298e31d5cb76-kube-api-access-jmdg7\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.063799 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.063646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/847d128f-9bc6-4727-a5be-298e31d5cb76-cert\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.063840 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:04:58.063804 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 14:04:58.063897 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:04:58.063886 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847d128f-9bc6-4727-a5be-298e31d5cb76-cert podName:847d128f-9bc6-4727-a5be-298e31d5cb76 nodeName:}" failed. No retries permitted until 2026-07-09 14:04:58.563868337 +0000 UTC m=+532.508476063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/847d128f-9bc6-4727-a5be-298e31d5cb76-cert") pod "kserve-controller-manager-d6f4b65b8-47rnb" (UID: "847d128f-9bc6-4727-a5be-298e31d5cb76") : secret "kserve-webhook-server-cert" not found Jul 09 14:04:58.087226 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.087147 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmdg7\" (UniqueName: \"kubernetes.io/projected/847d128f-9bc6-4727-a5be-298e31d5cb76-kube-api-access-jmdg7\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.398546 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.398426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:58.569109 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.569077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/847d128f-9bc6-4727-a5be-298e31d5cb76-cert\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.571717 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.571690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/847d128f-9bc6-4727-a5be-298e31d5cb76-cert\") pod \"kserve-controller-manager-d6f4b65b8-47rnb\" (UID: \"847d128f-9bc6-4727-a5be-298e31d5cb76\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.577019 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.576994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:58.645351 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.645317 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caa42d6a-620f-4d44-9802-3821c950e132" path="/var/lib/kubelet/pods/caa42d6a-620f-4d44-9802-3821c950e132/volumes" Jul 09 14:04:58.751038 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.751008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:04:58.901471 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:58.901418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-47rnb"] Jul 09 14:04:58.903675 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:04:58.903651 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847d128f_9bc6_4727_a5be_298e31d5cb76.slice/crio-464d203c84e569fc3522c8a1bee6ec9b1405fe78a49bf8f7aeec2c8e9c6afaec WatchSource:0}: Error finding container 464d203c84e569fc3522c8a1bee6ec9b1405fe78a49bf8f7aeec2c8e9c6afaec: Status 404 returned error can't find the container with id 464d203c84e569fc3522c8a1bee6ec9b1405fe78a49bf8f7aeec2c8e9c6afaec Jul 09 14:04:59.149826 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:59.149740 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:59.591024 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:59.590989 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" event={"ID":"847d128f-9bc6-4727-a5be-298e31d5cb76","Type":"ContainerStarted","Data":"464d203c84e569fc3522c8a1bee6ec9b1405fe78a49bf8f7aeec2c8e9c6afaec"} Jul 09 14:04:59.949547 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:04:59.949429 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:02.556290 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:02.556259 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ptzrp" Jul 09 14:05:02.558415 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:02.558389 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-k7bs9" Jul 09 14:05:02.606535 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:02.606485 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" event={"ID":"847d128f-9bc6-4727-a5be-298e31d5cb76","Type":"ContainerStarted","Data":"c1d23274a40338fa87f74d026a1b3bec11c6eb82800a718e57e547e201866298"} Jul 09 14:05:02.606713 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:02.606578 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:05:02.777630 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:02.777576 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" podStartSLOduration=2.947563089 podStartE2EDuration="5.777558166s" totalImagesPullingTime="2.829995077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:02.776859076 +0000 UTC m=+536.721466822" watchObservedRunningTime="2026-07-09 14:05:02.777558166 +0000 UTC m=+536.722165911" Jul 09 14:05:33.617913 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:33.617883 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-47rnb" Jul 09 14:05:33.807701 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:33.807641 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:46.459990 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.459892 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:46.554320 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.554290 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:46.586370 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.586339 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntzwm"] Jul 09 14:05:46.590151 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.590135 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:46.593485 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.593459 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:05:46.593637 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.593436 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:05:46.594508 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.594489 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cnl49\"" Jul 09 14:05:46.598819 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.598790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntzwm"] Jul 09 14:05:46.651978 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.651945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:46.658784 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.658757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5zl\" (UniqueName: \"kubernetes.io/projected/9ed1df61-444a-40cb-a1ca-16919887b7f5-kube-api-access-pg5zl\") pod \"kuadrant-operator-catalog-ntzwm\" (UID: \"9ed1df61-444a-40cb-a1ca-16919887b7f5\") " pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:46.759827 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.759794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5zl\" (UniqueName: \"kubernetes.io/projected/9ed1df61-444a-40cb-a1ca-16919887b7f5-kube-api-access-pg5zl\") pod \"kuadrant-operator-catalog-ntzwm\" (UID: \"9ed1df61-444a-40cb-a1ca-16919887b7f5\") " pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:46.769498 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.769471 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5zl\" (UniqueName: \"kubernetes.io/projected/9ed1df61-444a-40cb-a1ca-16919887b7f5-kube-api-access-pg5zl\") pod \"kuadrant-operator-catalog-ntzwm\" (UID: \"9ed1df61-444a-40cb-a1ca-16919887b7f5\") " pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:46.901754 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.901721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:46.952327 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:46.952262 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntzwm"] Jul 09 14:05:47.036871 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.036844 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntzwm"] Jul 09 14:05:47.038981 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:05:47.038955 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed1df61_444a_40cb_a1ca_16919887b7f5.slice/crio-baf09a7f2f5f66ac03f14672e79cb800c2965951044cd3f3d8d5ef92468b92e7 WatchSource:0}: Error finding container baf09a7f2f5f66ac03f14672e79cb800c2965951044cd3f3d8d5ef92468b92e7: Status 404 returned error can't find the container with id baf09a7f2f5f66ac03f14672e79cb800c2965951044cd3f3d8d5ef92468b92e7 Jul 09 14:05:47.159074 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.159041 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72x57"] Jul 09 14:05:47.161989 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.161973 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:47.171878 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.171857 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72x57"] Jul 09 14:05:47.264005 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.263972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/2c6ecf82-0da5-41fb-8870-0dbbab06d7f1-kube-api-access-cp6t8\") pod \"kuadrant-operator-catalog-72x57\" (UID: \"2c6ecf82-0da5-41fb-8870-0dbbab06d7f1\") " pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:47.365340 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.365235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/2c6ecf82-0da5-41fb-8870-0dbbab06d7f1-kube-api-access-cp6t8\") pod \"kuadrant-operator-catalog-72x57\" (UID: \"2c6ecf82-0da5-41fb-8870-0dbbab06d7f1\") " pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:47.379913 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.379890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/2c6ecf82-0da5-41fb-8870-0dbbab06d7f1-kube-api-access-cp6t8\") pod \"kuadrant-operator-catalog-72x57\" (UID: \"2c6ecf82-0da5-41fb-8870-0dbbab06d7f1\") " pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:47.472083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.472052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:47.631789 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.631764 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72x57"] Jul 09 14:05:47.634294 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:05:47.634258 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6ecf82_0da5_41fb_8870_0dbbab06d7f1.slice/crio-43dc7cd3ede28180abedf902a7c2808104d9c9a97a99197b54ea9e4745ff0fc2 WatchSource:0}: Error finding container 43dc7cd3ede28180abedf902a7c2808104d9c9a97a99197b54ea9e4745ff0fc2: Status 404 returned error can't find the container with id 43dc7cd3ede28180abedf902a7c2808104d9c9a97a99197b54ea9e4745ff0fc2 Jul 09 14:05:47.797358 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.797326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-72x57" event={"ID":"2c6ecf82-0da5-41fb-8870-0dbbab06d7f1","Type":"ContainerStarted","Data":"43dc7cd3ede28180abedf902a7c2808104d9c9a97a99197b54ea9e4745ff0fc2"} Jul 09 14:05:47.798499 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:47.798470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" event={"ID":"9ed1df61-444a-40cb-a1ca-16919887b7f5","Type":"ContainerStarted","Data":"baf09a7f2f5f66ac03f14672e79cb800c2965951044cd3f3d8d5ef92468b92e7"} Jul 09 14:05:51.819242 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:51.819205 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-72x57" event={"ID":"2c6ecf82-0da5-41fb-8870-0dbbab06d7f1","Type":"ContainerStarted","Data":"78905b00304acdbe70c692f8df30d38e23b916b4f2168fd9e6d44c3f55671311"} Jul 09 14:05:51.820605 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:51.820581 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" event={"ID":"9ed1df61-444a-40cb-a1ca-16919887b7f5","Type":"ContainerStarted","Data":"76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6"} Jul 09 14:05:51.820696 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:51.820622 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" podUID="9ed1df61-444a-40cb-a1ca-16919887b7f5" containerName="registry-server" containerID="cri-o://76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6" gracePeriod=2 Jul 09 14:05:51.834623 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:51.834583 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-72x57" podStartSLOduration=0.977521894 podStartE2EDuration="4.834568631s" totalImagesPullingTime="3.857046737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:51.83402957 +0000 UTC m=+585.778637315" watchObservedRunningTime="2026-07-09 14:05:51.834568631 +0000 UTC m=+585.779176376" Jul 09 14:05:51.851690 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:51.851642 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" podStartSLOduration=1.3957068000000001 podStartE2EDuration="5.851625757s" totalImagesPullingTime="4.455918957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:51.850518447 +0000 UTC m=+585.795126194" watchObservedRunningTime="2026-07-09 14:05:51.851625757 +0000 UTC m=+585.796233501" Jul 09 14:05:52.068056 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.068032 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:52.104494 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.104388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg5zl\" (UniqueName: \"kubernetes.io/projected/9ed1df61-444a-40cb-a1ca-16919887b7f5-kube-api-access-pg5zl\") pod \"9ed1df61-444a-40cb-a1ca-16919887b7f5\" (UID: \"9ed1df61-444a-40cb-a1ca-16919887b7f5\") " Jul 09 14:05:52.106745 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.106708 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed1df61-444a-40cb-a1ca-16919887b7f5-kube-api-access-pg5zl" (OuterVolumeSpecName: "kube-api-access-pg5zl") pod "9ed1df61-444a-40cb-a1ca-16919887b7f5" (UID: "9ed1df61-444a-40cb-a1ca-16919887b7f5"). InnerVolumeSpecName "kube-api-access-pg5zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:52.205535 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.205508 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg5zl\" (UniqueName: \"kubernetes.io/projected/9ed1df61-444a-40cb-a1ca-16919887b7f5-kube-api-access-pg5zl\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:05:52.826855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.826753 2559 generic.go:356] "Generic (PLEG): container finished" podID="9ed1df61-444a-40cb-a1ca-16919887b7f5" containerID="76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6" exitCode=0 Jul 09 14:05:52.826855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.826792 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" Jul 09 14:05:52.826855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.826836 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" event={"ID":"9ed1df61-444a-40cb-a1ca-16919887b7f5","Type":"ContainerDied","Data":"76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6"} Jul 09 14:05:52.827394 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.826880 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntzwm" event={"ID":"9ed1df61-444a-40cb-a1ca-16919887b7f5","Type":"ContainerDied","Data":"baf09a7f2f5f66ac03f14672e79cb800c2965951044cd3f3d8d5ef92468b92e7"} Jul 09 14:05:52.827394 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.826908 2559 scope.go:117] "RemoveContainer" containerID="76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6" Jul 09 14:05:52.836132 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.836115 2559 scope.go:117] "RemoveContainer" containerID="76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6" Jul 09 14:05:52.836389 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:05:52.836369 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6\": container with ID starting with 76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6 not found: ID does not exist" containerID="76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6" Jul 09 14:05:52.836466 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.836398 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6"} err="failed to get container status \"76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6\": rpc error: code = NotFound desc = could not find container \"76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6\": container with ID starting with 76ccb6531b0f1cb879ce0b5a48e155888d9965ec71ca4b5af095a69c1aaf35a6 not found: ID does not exist" Jul 09 14:05:52.844591 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.844566 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntzwm"] Jul 09 14:05:52.853801 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:52.853779 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntzwm"] Jul 09 14:05:54.648163 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:54.648134 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ed1df61-444a-40cb-a1ca-16919887b7f5" path="/var/lib/kubelet/pods/9ed1df61-444a-40cb-a1ca-16919887b7f5/volumes" Jul 09 14:05:57.472541 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:57.472496 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:57.472973 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:57.472561 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:57.495237 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:57.495214 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:05:57.872110 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:05:57.872081 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-72x57" Jul 09 14:06:06.519937 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:06.519907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:06:06.520408 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:06.520065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:06:10.535976 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.535944 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c54d5864-qzcdd"] Jul 09 14:06:10.536396 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.536263 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed1df61-444a-40cb-a1ca-16919887b7f5" containerName="registry-server" Jul 09 14:06:10.536396 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.536274 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed1df61-444a-40cb-a1ca-16919887b7f5" containerName="registry-server" Jul 09 14:06:10.536396 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.536345 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ed1df61-444a-40cb-a1ca-16919887b7f5" containerName="registry-server" Jul 09 14:06:10.538260 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.538240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.543225 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.543206 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:06:10.543635 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.543614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p6gtz\"" Jul 09 14:06:10.543747 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.543644 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:06:10.544768 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.544627 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:06:10.544768 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.544641 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:06:10.544768 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.544730 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:06:10.548515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.548499 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:06:10.551931 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.551912 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c54d5864-qzcdd"] Jul 09 14:06:10.586291 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.586240 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:10.645421 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.645390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:10.670525 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-oauth-serving-cert\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.670525 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28jcg\" (UniqueName: \"kubernetes.io/projected/de779228-6151-4df0-b0e6-425fef8cb034-kube-api-access-28jcg\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.670714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de779228-6151-4df0-b0e6-425fef8cb034-console-oauth-config\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.670714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-console-config\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.670714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de779228-6151-4df0-b0e6-425fef8cb034-console-serving-cert\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.670714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-service-ca\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.670714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.670701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-trusted-ca-bundle\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771579 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-trusted-ca-bundle\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-oauth-serving-cert\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28jcg\" (UniqueName: \"kubernetes.io/projected/de779228-6151-4df0-b0e6-425fef8cb034-kube-api-access-28jcg\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de779228-6151-4df0-b0e6-425fef8cb034-console-oauth-config\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771776 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-console-config\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771981 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de779228-6151-4df0-b0e6-425fef8cb034-console-serving-cert\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.771981 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.771807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-service-ca\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.772473 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.772418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-oauth-serving-cert\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.772473 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.772433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-service-ca\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.772735 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.772714 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-trusted-ca-bundle\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.772772 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.772732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de779228-6151-4df0-b0e6-425fef8cb034-console-config\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.774409 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.774385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de779228-6151-4df0-b0e6-425fef8cb034-console-oauth-config\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.774516 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.774487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de779228-6151-4df0-b0e6-425fef8cb034-console-serving-cert\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.779959 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.779937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28jcg\" (UniqueName: \"kubernetes.io/projected/de779228-6151-4df0-b0e6-425fef8cb034-kube-api-access-28jcg\") pod \"console-54c54d5864-qzcdd\" (UID: \"de779228-6151-4df0-b0e6-425fef8cb034\") " pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:10.848073 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:10.848032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:11.001087 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:11.001053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c54d5864-qzcdd"] Jul 09 14:06:11.003887 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:06:11.003855 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde779228_6151_4df0_b0e6_425fef8cb034.slice/crio-4b0b50b8309926b2a857bede9dde7ccb0e256046f30053faf9eac6f3054a3331 WatchSource:0}: Error finding container 4b0b50b8309926b2a857bede9dde7ccb0e256046f30053faf9eac6f3054a3331: Status 404 returned error can't find the container with id 4b0b50b8309926b2a857bede9dde7ccb0e256046f30053faf9eac6f3054a3331 Jul 09 14:06:11.922918 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:11.922883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c54d5864-qzcdd" event={"ID":"de779228-6151-4df0-b0e6-425fef8cb034","Type":"ContainerStarted","Data":"098b576e4762c6114b638308f07cac4d4eb7aa9e5bd18e04b48ae745195a55d0"} Jul 09 14:06:11.923305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:11.922964 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c54d5864-qzcdd" event={"ID":"de779228-6151-4df0-b0e6-425fef8cb034","Type":"ContainerStarted","Data":"4b0b50b8309926b2a857bede9dde7ccb0e256046f30053faf9eac6f3054a3331"} Jul 09 14:06:11.940237 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:11.940186 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c54d5864-qzcdd" podStartSLOduration=1.940168825 podStartE2EDuration="1.940168825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:11.939824459 +0000 UTC m=+605.884432204" watchObservedRunningTime="2026-07-09 14:06:11.940168825 +0000 UTC m=+605.884776571" Jul 09 14:06:16.883086 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:16.883052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:19.528857 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.528817 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh"] Jul 09 14:06:19.531589 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.531572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:19.535871 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.535851 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gbvz4\"" Jul 09 14:06:19.536348 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.536334 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 14:06:19.545684 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.545660 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh"] Jul 09 14:06:19.649620 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.649590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkxmf\" (UniqueName: \"kubernetes.io/projected/44c8297f-1897-49d0-8c1c-13f40c39f051-kube-api-access-pkxmf\") pod \"dns-operator-controller-manager-864dd78c4c-wz7jh\" (UID: \"44c8297f-1897-49d0-8c1c-13f40c39f051\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:19.750964 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.750935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkxmf\" (UniqueName: \"kubernetes.io/projected/44c8297f-1897-49d0-8c1c-13f40c39f051-kube-api-access-pkxmf\") pod \"dns-operator-controller-manager-864dd78c4c-wz7jh\" (UID: \"44c8297f-1897-49d0-8c1c-13f40c39f051\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:19.760914 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.760889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkxmf\" (UniqueName: \"kubernetes.io/projected/44c8297f-1897-49d0-8c1c-13f40c39f051-kube-api-access-pkxmf\") pod \"dns-operator-controller-manager-864dd78c4c-wz7jh\" (UID: \"44c8297f-1897-49d0-8c1c-13f40c39f051\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:19.842624 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.842537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:19.996347 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:19.996323 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh"] Jul 09 14:06:19.998766 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:06:19.998739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c8297f_1897_49d0_8c1c_13f40c39f051.slice/crio-b7bf38fd7e02206a11693b1042d31fa475c2ba74ca0cb178b72f0e018fdbd050 WatchSource:0}: Error finding container b7bf38fd7e02206a11693b1042d31fa475c2ba74ca0cb178b72f0e018fdbd050: Status 404 returned error can't find the container with id b7bf38fd7e02206a11693b1042d31fa475c2ba74ca0cb178b72f0e018fdbd050 Jul 09 14:06:20.000957 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.000942 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:06:20.469993 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.469957 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:20.848183 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.848151 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:20.848625 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.848217 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:20.852840 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.852818 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:20.966241 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.966202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" event={"ID":"44c8297f-1897-49d0-8c1c-13f40c39f051","Type":"ContainerStarted","Data":"b7bf38fd7e02206a11693b1042d31fa475c2ba74ca0cb178b72f0e018fdbd050"} Jul 09 14:06:20.970886 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:20.970859 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c54d5864-qzcdd" Jul 09 14:06:21.196065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:21.195982 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:21.290410 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:21.290373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:22.978873 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:22.978838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" event={"ID":"44c8297f-1897-49d0-8c1c-13f40c39f051","Type":"ContainerStarted","Data":"31d5269c0ce2f23f4e2a0406fbd9b0b0638dca6499ca8d618e8f77d518c92da8"} Jul 09 14:06:22.979361 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:22.979090 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:22.997856 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:22.997789 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" podStartSLOduration=1.74235044 podStartE2EDuration="3.997769656s" totalImagesPullingTime="2.255419216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:22.995074545 +0000 UTC m=+616.939682290" watchObservedRunningTime="2026-07-09 14:06:22.997769656 +0000 UTC m=+616.942377403" Jul 09 14:06:23.545155 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:23.545121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:24.900998 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:24.900958 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l"] Jul 09 14:06:24.906374 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:24.906354 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:24.921628 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:24.921608 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kxxnp\"" Jul 09 14:06:24.939424 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:24.939394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l"] Jul 09 14:06:25.005816 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.005786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:25.100064 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.100029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.100245 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.100089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c6n7\" (UniqueName: \"kubernetes.io/projected/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-kube-api-access-2c6n7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.201294 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.201210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c6n7\" (UniqueName: \"kubernetes.io/projected/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-kube-api-access-2c6n7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.201475 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.201305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.201671 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.201654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.215585 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.215550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c6n7\" (UniqueName: \"kubernetes.io/projected/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-kube-api-access-2c6n7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.215719 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.215693 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:25.349552 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.349526 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l"] Jul 09 14:06:25.352532 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:06:25.352500 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce11b0a_8ab4_45c7_bec8_4c7a5d65fadc.slice/crio-cfb97a4312cba89fbb68d00b40cba54319bae57cb2f4615fbad5d83f54ba560d WatchSource:0}: Error finding container cfb97a4312cba89fbb68d00b40cba54319bae57cb2f4615fbad5d83f54ba560d: Status 404 returned error can't find the container with id cfb97a4312cba89fbb68d00b40cba54319bae57cb2f4615fbad5d83f54ba560d Jul 09 14:06:25.902018 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.901977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:25.993485 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:25.993429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" event={"ID":"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc","Type":"ContainerStarted","Data":"cfb97a4312cba89fbb68d00b40cba54319bae57cb2f4615fbad5d83f54ba560d"} Jul 09 14:06:28.062964 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:28.062870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:28.465326 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:28.465243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:28.755508 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:28.755424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:31.018568 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.018530 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" event={"ID":"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc","Type":"ContainerStarted","Data":"83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff"} Jul 09 14:06:31.019094 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.018665 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:31.043068 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.043010 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" podStartSLOduration=2.365716457 podStartE2EDuration="7.042988127s" totalImagesPullingTime="4.67727167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:31.042542245 +0000 UTC m=+624.987150183" watchObservedRunningTime="2026-07-09 14:06:31.042988127 +0000 UTC m=+624.987595941" Jul 09 14:06:31.172292 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.172258 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd"] Jul 09 14:06:31.175799 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.175782 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:31.179187 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.179163 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8nnpk\"" Jul 09 14:06:31.202595 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.202563 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd"] Jul 09 14:06:31.257890 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.257855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86r4\" (UniqueName: \"kubernetes.io/projected/7667926d-241a-4f22-81d4-78fa20e6901a-kube-api-access-r86r4\") pod \"authorino-operator-75cc8d5cb7-jnpzd\" (UID: \"7667926d-241a-4f22-81d4-78fa20e6901a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:31.358947 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.358864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r86r4\" (UniqueName: \"kubernetes.io/projected/7667926d-241a-4f22-81d4-78fa20e6901a-kube-api-access-r86r4\") pod \"authorino-operator-75cc8d5cb7-jnpzd\" (UID: \"7667926d-241a-4f22-81d4-78fa20e6901a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:31.368804 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.368770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r86r4\" (UniqueName: \"kubernetes.io/projected/7667926d-241a-4f22-81d4-78fa20e6901a-kube-api-access-r86r4\") pod \"authorino-operator-75cc8d5cb7-jnpzd\" (UID: \"7667926d-241a-4f22-81d4-78fa20e6901a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:31.486167 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.486132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:31.554941 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.554887 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:31.640160 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:31.640136 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd"] Jul 09 14:06:31.643063 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:06:31.643034 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7667926d_241a_4f22_81d4_78fa20e6901a.slice/crio-9db245bc533aab0c725e523aaae0ce4ff82510ab69fc3c8dc6d85db609366400 WatchSource:0}: Error finding container 9db245bc533aab0c725e523aaae0ce4ff82510ab69fc3c8dc6d85db609366400: Status 404 returned error can't find the container with id 9db245bc533aab0c725e523aaae0ce4ff82510ab69fc3c8dc6d85db609366400 Jul 09 14:06:32.024743 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:32.024706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" event={"ID":"7667926d-241a-4f22-81d4-78fa20e6901a","Type":"ContainerStarted","Data":"9db245bc533aab0c725e523aaae0ce4ff82510ab69fc3c8dc6d85db609366400"} Jul 09 14:06:32.905804 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:32.905766 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:33.003980 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:33.003946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:33.491310 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:33.491280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:33.986287 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:33.986260 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wz7jh" Jul 09 14:06:35.042324 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:35.042281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" event={"ID":"7667926d-241a-4f22-81d4-78fa20e6901a","Type":"ContainerStarted","Data":"a07850bfcdeda41c2c8c20fca4c11541b23a016689bf8986a19d55f2e5edd4d3"} Jul 09 14:06:35.042730 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:35.042427 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:35.072430 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:35.072376 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" podStartSLOduration=1.67606134 podStartE2EDuration="4.072360763s" totalImagesPullingTime="2.396299423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:35.070056702 +0000 UTC m=+629.014664442" watchObservedRunningTime="2026-07-09 14:06:35.072360763 +0000 UTC m=+629.016968508" Jul 09 14:06:36.467232 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:36.467198 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:36.525347 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:36.525317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:42.027785 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:42.027753 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:43.805428 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.805387 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l"] Jul 09 14:06:43.805913 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.805630 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" containerName="manager" containerID="cri-o://83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff" gracePeriod=2 Jul 09 14:06:43.825615 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.825590 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l"] Jul 09 14:06:43.835135 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.835107 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf"] Jul 09 14:06:43.835480 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.835467 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" containerName="manager" Jul 09 14:06:43.835527 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.835483 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" containerName="manager" Jul 09 14:06:43.835561 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.835552 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" containerName="manager" Jul 09 14:06:43.835951 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:43.835920 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\": pods \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:43.839537 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.839514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:43.841716 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:43.841682 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:43.853312 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.853285 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf"] Jul 09 14:06:43.974334 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.974291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45d7847b-f7dc-45dc-bea7-81db8b77a179-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9srtf\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:43.974334 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:43.974338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffwpd\" (UniqueName: \"kubernetes.io/projected/45d7847b-f7dc-45dc-bea7-81db8b77a179-kube-api-access-ffwpd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9srtf\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:44.051235 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.051212 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:44.053584 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:44.053555 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:44.076098 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.076029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45d7847b-f7dc-45dc-bea7-81db8b77a179-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9srtf\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:44.076098 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.076071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffwpd\" (UniqueName: \"kubernetes.io/projected/45d7847b-f7dc-45dc-bea7-81db8b77a179-kube-api-access-ffwpd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9srtf\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:44.076399 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.076380 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45d7847b-f7dc-45dc-bea7-81db8b77a179-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9srtf\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:44.085373 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.085347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffwpd\" (UniqueName: \"kubernetes.io/projected/45d7847b-f7dc-45dc-bea7-81db8b77a179-kube-api-access-ffwpd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9srtf\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:44.090951 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.090923 2559 generic.go:356] "Generic (PLEG): container finished" podID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" containerID="83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff" exitCode=0 Jul 09 14:06:44.091045 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.090971 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:44.091045 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.091028 2559 scope.go:117] "RemoveContainer" containerID="83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff" Jul 09 14:06:44.093272 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:44.093231 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:44.099977 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.099960 2559 scope.go:117] "RemoveContainer" containerID="83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff" Jul 09 14:06:44.100223 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:44.100204 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff\": container with ID starting with 83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff not found: ID does not exist" containerID="83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff" Jul 09 14:06:44.100279 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.100232 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff"} err="failed to get container status \"83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff\": rpc error: code = NotFound desc = could not find container \"83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff\": container with ID starting with 83e4d82dd5c2c7623fb3b877cbd91c826873538d44f7dee343741378dec7d8ff not found: ID does not exist" Jul 09 14:06:44.177299 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.177266 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c6n7\" (UniqueName: \"kubernetes.io/projected/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-kube-api-access-2c6n7\") pod \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " Jul 09 14:06:44.177299 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.177314 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-extensions-socket-volume\") pod \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\" (UID: \"fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc\") " Jul 09 14:06:44.177830 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.177809 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" (UID: "fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:06:44.179616 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.179587 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-kube-api-access-2c6n7" (OuterVolumeSpecName: "kube-api-access-2c6n7") pod "fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" (UID: "fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc"). InnerVolumeSpecName "kube-api-access-2c6n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:06:44.187720 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.187697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:44.278164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.278130 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-extensions-socket-volume\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:44.278164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.278166 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c6n7\" (UniqueName: \"kubernetes.io/projected/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc-kube-api-access-2c6n7\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:44.335588 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.335561 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf"] Jul 09 14:06:44.338049 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:06:44.338027 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d7847b_f7dc_45dc_bea7_81db8b77a179.slice/crio-ed00e0e7d0df7ecba1f4bd10a7efba511dee521c9540bf0660bbd038d7161e24 WatchSource:0}: Error finding container ed00e0e7d0df7ecba1f4bd10a7efba511dee521c9540bf0660bbd038d7161e24: Status 404 returned error can't find the container with id ed00e0e7d0df7ecba1f4bd10a7efba511dee521c9540bf0660bbd038d7161e24 Jul 09 14:06:44.404699 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:44.404667 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8q5l\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8q5l" Jul 09 14:06:44.646821 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.646736 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc" path="/var/lib/kubelet/pods/fce11b0a-8ab4-45c7-bec8-4c7a5d65fadc/volumes" Jul 09 14:06:44.700981 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.700943 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x"] Jul 09 14:06:44.704556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.704539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:44.724601 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.724576 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x"] Jul 09 14:06:44.782427 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.782391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/958974e8-8f79-44ca-8fff-064f902252a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xlc4x\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:44.782631 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.782464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcsmd\" (UniqueName: \"kubernetes.io/projected/958974e8-8f79-44ca-8fff-064f902252a2-kube-api-access-gcsmd\") pod \"kuadrant-operator-controller-manager-86878c769f-xlc4x\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:44.883751 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.883717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/958974e8-8f79-44ca-8fff-064f902252a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xlc4x\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:44.883751 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.883759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcsmd\" (UniqueName: \"kubernetes.io/projected/958974e8-8f79-44ca-8fff-064f902252a2-kube-api-access-gcsmd\") pod \"kuadrant-operator-controller-manager-86878c769f-xlc4x\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:44.884313 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.884167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/958974e8-8f79-44ca-8fff-064f902252a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xlc4x\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:44.909168 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:44.909090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcsmd\" (UniqueName: \"kubernetes.io/projected/958974e8-8f79-44ca-8fff-064f902252a2-kube-api-access-gcsmd\") pod \"kuadrant-operator-controller-manager-86878c769f-xlc4x\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:45.014507 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.014469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:45.099017 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.098979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" event={"ID":"45d7847b-f7dc-45dc-bea7-81db8b77a179","Type":"ContainerStarted","Data":"ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292"} Jul 09 14:06:45.099153 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.099030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" event={"ID":"45d7847b-f7dc-45dc-bea7-81db8b77a179","Type":"ContainerStarted","Data":"ed00e0e7d0df7ecba1f4bd10a7efba511dee521c9540bf0660bbd038d7161e24"} Jul 09 14:06:45.099153 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.099115 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:45.128531 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.128476 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" podStartSLOduration=2.12845769 podStartE2EDuration="2.12845769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:45.127042902 +0000 UTC m=+639.071650648" watchObservedRunningTime="2026-07-09 14:06:45.12845769 +0000 UTC m=+639.073065426" Jul 09 14:06:45.162515 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.162490 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x"] Jul 09 14:06:45.164599 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:06:45.164566 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958974e8_8f79_44ca_8fff_064f902252a2.slice/crio-27dbc2aa85f08c097bc2ef2162eed9b1dc32290c3d7ecc68a11f43c107c89be4 WatchSource:0}: Error finding container 27dbc2aa85f08c097bc2ef2162eed9b1dc32290c3d7ecc68a11f43c107c89be4: Status 404 returned error can't find the container with id 27dbc2aa85f08c097bc2ef2162eed9b1dc32290c3d7ecc68a11f43c107c89be4 Jul 09 14:06:45.576160 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.576126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:45.670598 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:45.670567 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:46.050336 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:46.050301 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jnpzd" Jul 09 14:06:46.106073 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:46.106028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" event={"ID":"958974e8-8f79-44ca-8fff-064f902252a2","Type":"ContainerStarted","Data":"14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541"} Jul 09 14:06:46.106257 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:46.106083 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" event={"ID":"958974e8-8f79-44ca-8fff-064f902252a2","Type":"ContainerStarted","Data":"27dbc2aa85f08c097bc2ef2162eed9b1dc32290c3d7ecc68a11f43c107c89be4"} Jul 09 14:06:46.126499 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:46.126412 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" podStartSLOduration=2.126396232 podStartE2EDuration="2.126396232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:46.125670185 +0000 UTC m=+640.070277932" watchObservedRunningTime="2026-07-09 14:06:46.126396232 +0000 UTC m=+640.071003976" Jul 09 14:06:47.110595 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:47.110567 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:49.310165 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:49.310128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:49.415747 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:49.415712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:49.978595 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:49.978561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:50.089817 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:50.089776 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:55.074358 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:55.074328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:55.172040 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:55.172003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:56.108162 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:56.108132 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:57.504903 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:57.504873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:57.605051 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:57.605017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:58.118061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.118027 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:06:58.172966 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.172931 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf"] Jul 09 14:06:58.173275 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.173184 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" podUID="45d7847b-f7dc-45dc-bea7-81db8b77a179" containerName="manager" containerID="cri-o://ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292" gracePeriod=10 Jul 09 14:06:58.429013 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.428989 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:58.620651 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.620617 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45d7847b-f7dc-45dc-bea7-81db8b77a179-extensions-socket-volume\") pod \"45d7847b-f7dc-45dc-bea7-81db8b77a179\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " Jul 09 14:06:58.620651 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.620658 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffwpd\" (UniqueName: \"kubernetes.io/projected/45d7847b-f7dc-45dc-bea7-81db8b77a179-kube-api-access-ffwpd\") pod \"45d7847b-f7dc-45dc-bea7-81db8b77a179\" (UID: \"45d7847b-f7dc-45dc-bea7-81db8b77a179\") " Jul 09 14:06:58.621065 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.620965 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45d7847b-f7dc-45dc-bea7-81db8b77a179-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "45d7847b-f7dc-45dc-bea7-81db8b77a179" (UID: "45d7847b-f7dc-45dc-bea7-81db8b77a179"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:06:58.622930 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.622908 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d7847b-f7dc-45dc-bea7-81db8b77a179-kube-api-access-ffwpd" (OuterVolumeSpecName: "kube-api-access-ffwpd") pod "45d7847b-f7dc-45dc-bea7-81db8b77a179" (UID: "45d7847b-f7dc-45dc-bea7-81db8b77a179"). InnerVolumeSpecName "kube-api-access-ffwpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:06:58.721824 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.721783 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45d7847b-f7dc-45dc-bea7-81db8b77a179-extensions-socket-volume\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:58.721824 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:58.721819 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffwpd\" (UniqueName: \"kubernetes.io/projected/45d7847b-f7dc-45dc-bea7-81db8b77a179-kube-api-access-ffwpd\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:59.090222 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.090188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:59.171352 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.171317 2559 generic.go:356] "Generic (PLEG): container finished" podID="45d7847b-f7dc-45dc-bea7-81db8b77a179" containerID="ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292" exitCode=0 Jul 09 14:06:59.171555 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.171368 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" Jul 09 14:06:59.171555 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.171399 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" event={"ID":"45d7847b-f7dc-45dc-bea7-81db8b77a179","Type":"ContainerDied","Data":"ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292"} Jul 09 14:06:59.171555 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.171475 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf" event={"ID":"45d7847b-f7dc-45dc-bea7-81db8b77a179","Type":"ContainerDied","Data":"ed00e0e7d0df7ecba1f4bd10a7efba511dee521c9540bf0660bbd038d7161e24"} Jul 09 14:06:59.171555 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.171507 2559 scope.go:117] "RemoveContainer" containerID="ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292" Jul 09 14:06:59.180609 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.180400 2559 scope.go:117] "RemoveContainer" containerID="ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292" Jul 09 14:06:59.180707 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:06:59.180687 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292\": container with ID starting with ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292 not found: ID does not exist" containerID="ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292" Jul 09 14:06:59.180749 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.180716 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292"} err="failed to get container status \"ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292\": rpc error: code = NotFound desc = could not find container \"ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292\": container with ID starting with ce61c102dbe3891e00ad9c59586be564eb9742404978add84b5260d16738b292 not found: ID does not exist" Jul 09 14:06:59.187736 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.187702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:59.195584 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.195564 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf"] Jul 09 14:06:59.199293 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:06:59.199272 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9srtf"] Jul 09 14:07:00.646031 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:00.645989 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d7847b-f7dc-45dc-bea7-81db8b77a179" path="/var/lib/kubelet/pods/45d7847b-f7dc-45dc-bea7-81db8b77a179/volumes" Jul 09 14:07:02.670883 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:02.670852 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:02.771509 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:02.771430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:08.199859 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:08.199823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:08.301061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:08.301016 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:11.508016 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:11.507981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:11.609319 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:11.609268 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.118520 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:14.118472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.268593 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:14.268562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.520669 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:14.520634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.722778 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:14.722749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:16.702879 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:16.702842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:16.780864 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:16.780830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:16.852341 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:16.852314 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:17.257378 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.257345 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:07:17.257730 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.257717 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d7847b-f7dc-45dc-bea7-81db8b77a179" containerName="manager" Jul 09 14:07:17.257779 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.257732 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d7847b-f7dc-45dc-bea7-81db8b77a179" containerName="manager" Jul 09 14:07:17.257813 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.257800 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d7847b-f7dc-45dc-bea7-81db8b77a179" containerName="manager" Jul 09 14:07:17.262521 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.262500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.265581 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.265564 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vh7wf\"" Jul 09 14:07:17.265671 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.265584 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 14:07:17.273608 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.273586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:07:17.322735 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.322698 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:07:17.373538 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.373503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfp2\" (UniqueName: \"kubernetes.io/projected/3642cc0f-5497-4bf8-be5f-b6a03d950d53-kube-api-access-crfp2\") pod \"limitador-limitador-54d6d988d5-fkmfb\" (UID: \"3642cc0f-5497-4bf8-be5f-b6a03d950d53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.373710 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.373555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3642cc0f-5497-4bf8-be5f-b6a03d950d53-config-file\") pod \"limitador-limitador-54d6d988d5-fkmfb\" (UID: \"3642cc0f-5497-4bf8-be5f-b6a03d950d53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.474045 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.474001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfp2\" (UniqueName: \"kubernetes.io/projected/3642cc0f-5497-4bf8-be5f-b6a03d950d53-kube-api-access-crfp2\") pod \"limitador-limitador-54d6d988d5-fkmfb\" (UID: \"3642cc0f-5497-4bf8-be5f-b6a03d950d53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.474240 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.474079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3642cc0f-5497-4bf8-be5f-b6a03d950d53-config-file\") pod \"limitador-limitador-54d6d988d5-fkmfb\" (UID: \"3642cc0f-5497-4bf8-be5f-b6a03d950d53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.474752 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.474733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3642cc0f-5497-4bf8-be5f-b6a03d950d53-config-file\") pod \"limitador-limitador-54d6d988d5-fkmfb\" (UID: \"3642cc0f-5497-4bf8-be5f-b6a03d950d53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.482717 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.482690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfp2\" (UniqueName: \"kubernetes.io/projected/3642cc0f-5497-4bf8-be5f-b6a03d950d53-kube-api-access-crfp2\") pod \"limitador-limitador-54d6d988d5-fkmfb\" (UID: \"3642cc0f-5497-4bf8-be5f-b6a03d950d53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.573956 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.573860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:17.575414 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.575384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:17.643473 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.643414 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:17.716532 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.716510 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:07:17.719250 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:07:17.719221 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3642cc0f_5497_4bf8_be5f_b6a03d950d53.slice/crio-672c9f7ece8b628ce0ce8dab1525c1ea396a711f660fa78650fe1fab5bdceafb WatchSource:0}: Error finding container 672c9f7ece8b628ce0ce8dab1525c1ea396a711f660fa78650fe1fab5bdceafb: Status 404 returned error can't find the container with id 672c9f7ece8b628ce0ce8dab1525c1ea396a711f660fa78650fe1fab5bdceafb Jul 09 14:07:17.920881 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:17.920793 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:18.262650 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:18.262616 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" event={"ID":"3642cc0f-5497-4bf8-be5f-b6a03d950d53","Type":"ContainerStarted","Data":"672c9f7ece8b628ce0ce8dab1525c1ea396a711f660fa78650fe1fab5bdceafb"} Jul 09 14:07:19.308984 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:19.308936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:21.280857 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:21.280817 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" event={"ID":"3642cc0f-5497-4bf8-be5f-b6a03d950d53","Type":"ContainerStarted","Data":"92f8031363c39cad7735772403344d36aafa7edb8d6f6764e33ad2cf9ac31b97"} Jul 09 14:07:21.281241 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:21.280889 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:21.299697 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:21.299649 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" podStartSLOduration=1.117776631 podStartE2EDuration="4.299631467s" totalImagesPullingTime="3.181854836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:07:21.298184066 +0000 UTC m=+675.242791824" watchObservedRunningTime="2026-07-09 14:07:21.299631467 +0000 UTC m=+675.244239245" Jul 09 14:07:26.108976 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:26.108940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:26.209300 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:26.209267 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:30.919763 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:30.919729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:31.040114 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:31.040080 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:32.287212 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:32.287182 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkmfb" Jul 09 14:07:37.842169 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:37.842124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:37.940539 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:37.940507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:39.019364 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:39.019331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:50.727691 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:50.727662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:50.842557 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:50.842515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:56.699928 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:56.699832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:56.796286 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:56.796253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:56.862293 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:07:56.862260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:01.236167 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:01.236124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:02.222485 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:02.222422 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:17.331847 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:17.331814 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:36.215766 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:36.215730 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:36.679409 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:36.679372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:37.109689 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:37.109634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:37.218294 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:37.218258 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:37.468233 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:37.468156 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:08:38.217959 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:38.217926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:39.791330 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:39.791294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:39.850046 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:39.850014 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:47.599041 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:47.599002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:47.706309 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:47.706249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:48.985396 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:08:48.985363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:16.190524 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:16.190489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:16.558001 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:16.557966 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:09:24.662852 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:24.662802 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:25.545087 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:25.545050 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:09:31.733138 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.733056 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws"] Jul 09 14:09:31.736640 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.736621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.739034 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.739006 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:09:31.739159 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.739140 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zc5jh\"" Jul 09 14:09:31.740150 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.740135 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:09:31.740247 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.740227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 14:09:31.746091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.746067 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws"] Jul 09 14:09:31.840721 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.840688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:31.858406 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.858378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78016d0-5f78-4756-b35f-743f0b49d672-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.858568 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.858417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.858568 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.858472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtzqp\" (UniqueName: \"kubernetes.io/projected/c78016d0-5f78-4756-b35f-743f0b49d672-kube-api-access-rtzqp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.858568 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.858544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.858673 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.858572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.858673 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.858591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959360 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78016d0-5f78-4756-b35f-743f0b49d672-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtzqp\" (UniqueName: \"kubernetes.io/projected/c78016d0-5f78-4756-b35f-743f0b49d672-kube-api-access-rtzqp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959724 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959820 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959800 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959874 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.959912 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.959875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.961895 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.961866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78016d0-5f78-4756-b35f-743f0b49d672-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.962139 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.962121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78016d0-5f78-4756-b35f-743f0b49d672-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:31.968002 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:31.967977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtzqp\" (UniqueName: \"kubernetes.io/projected/c78016d0-5f78-4756-b35f-743f0b49d672-kube-api-access-rtzqp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2xmws\" (UID: \"c78016d0-5f78-4756-b35f-743f0b49d672\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:32.046978 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:32.046940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:32.188046 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:32.188014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws"] Jul 09 14:09:32.189256 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:09:32.189225 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78016d0_5f78_4756_b35f_743f0b49d672.slice/crio-ab5a654da9ad64b349d6f985f2abb31a4b91cd1501329f89bbae90aecba7a7b8 WatchSource:0}: Error finding container ab5a654da9ad64b349d6f985f2abb31a4b91cd1501329f89bbae90aecba7a7b8: Status 404 returned error can't find the container with id ab5a654da9ad64b349d6f985f2abb31a4b91cd1501329f89bbae90aecba7a7b8 Jul 09 14:09:32.927485 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:32.927416 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" event={"ID":"c78016d0-5f78-4756-b35f-743f0b49d672","Type":"ContainerStarted","Data":"ab5a654da9ad64b349d6f985f2abb31a4b91cd1501329f89bbae90aecba7a7b8"} Jul 09 14:09:33.245086 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:33.245004 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:09:33.933861 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:33.933823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" event={"ID":"c78016d0-5f78-4756-b35f-743f0b49d672","Type":"ContainerStarted","Data":"fa1da4712c641c5e6c0a8a9927cbc2356566ab5d7a113a20449e61d6f4eb3672"} Jul 09 14:09:33.953585 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:33.953534 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" podStartSLOduration=1.868177413 podStartE2EDuration="2.953517829s" totalImagesPullingTime="1.085340416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:33.95238117 +0000 UTC m=+807.896988915" watchObservedRunningTime="2026-07-09 14:09:33.953517829 +0000 UTC m=+807.898125589" Jul 09 14:09:42.047849 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:42.047813 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:42.048257 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:42.047880 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:42.060165 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:42.060134 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:42.988248 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:42.988221 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2xmws" Jul 09 14:09:44.686006 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:44.685964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:46.342896 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:46.342863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:09:55.645735 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:55.645695 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:57.546354 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:09:57.546317 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:10:07.239072 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:10:07.239032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:09.946615 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:10:09.946570 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:10:21.873778 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:10:21.873730 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:21.928355 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:10:21.928316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:30.656742 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:10:30.656706 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:04.149261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:04.149165 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:05.944507 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:05.944464 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:06.554040 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:06.554005 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:11:06.556132 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:06.556108 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:11:35.651830 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:35.651792 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:11:44.957419 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:44.957385 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:11:56.647428 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:56.647398 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:11:57.344105 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:57.344073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:57.440578 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:11:57.440544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:04.351870 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:12:04.351832 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:12:15.444075 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:12:15.444038 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:12:18.035502 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:12:18.035434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:20.974280 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:12:20.974244 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:42.747355 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:12:42.747314 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:12:56.440559 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:12:56.440521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:13:01.809580 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:01.809542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:01.908762 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:01.908718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:02.027907 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:02.027876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:03.645656 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:03.645625 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:08.694610 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:08.694572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:08.761556 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:08.761516 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:08.843115 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:08.843058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:09.016910 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:09.016874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:09.116182 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:09.116151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:14.802659 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:14.802624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:14.874308 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:14.874272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:32.239952 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:32.239915 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:13:41.246793 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:41.246760 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:13:49.652800 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:49.652769 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:13:59.150606 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:13:59.150519 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:14:03.467427 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:03.467384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:03.567963 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:03.567927 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:09.540921 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:09.540885 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:14:19.061573 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:19.061535 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:14:30.256958 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:30.256924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:14:40.255534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:40.255498 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:14:46.448907 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:46.448872 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:14:54.250478 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:14:54.250427 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:15:00.143735 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.143698 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h"] Jul 09 14:15:00.147430 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.147407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:15:00.150245 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.150222 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 14:15:00.150357 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.150223 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 14:15:00.151130 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.151107 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-thdg4\"" Jul 09 14:15:00.168636 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.168609 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h"] Jul 09 14:15:00.238777 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.238734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7w8f\" (UniqueName: \"kubernetes.io/projected/ebf3f349-a077-487e-aa7b-ea11c258fc14-kube-api-access-w7w8f\") pod \"maas-api-key-cleanup-29726775-5p85h\" (UID: \"ebf3f349-a077-487e-aa7b-ea11c258fc14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:15:00.339808 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.339765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7w8f\" (UniqueName: \"kubernetes.io/projected/ebf3f349-a077-487e-aa7b-ea11c258fc14-kube-api-access-w7w8f\") pod \"maas-api-key-cleanup-29726775-5p85h\" (UID: \"ebf3f349-a077-487e-aa7b-ea11c258fc14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:15:00.347893 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.347857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7w8f\" (UniqueName: \"kubernetes.io/projected/ebf3f349-a077-487e-aa7b-ea11c258fc14-kube-api-access-w7w8f\") pod \"maas-api-key-cleanup-29726775-5p85h\" (UID: \"ebf3f349-a077-487e-aa7b-ea11c258fc14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:15:00.458002 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.457908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:15:00.594509 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.594487 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h"] Jul 09 14:15:00.597184 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:15:00.597159 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf3f349_a077_487e_aa7b_ea11c258fc14.slice/crio-5a9b08954f0edd94f84da1c3e0b4b1ae26f840e848f24503806e875a01979af6 WatchSource:0}: Error finding container 5a9b08954f0edd94f84da1c3e0b4b1ae26f840e848f24503806e875a01979af6: Status 404 returned error can't find the container with id 5a9b08954f0edd94f84da1c3e0b4b1ae26f840e848f24503806e875a01979af6 Jul 09 14:15:00.599379 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:00.599360 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:15:01.537962 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:01.537925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" event={"ID":"ebf3f349-a077-487e-aa7b-ea11c258fc14","Type":"ContainerStarted","Data":"5a9b08954f0edd94f84da1c3e0b4b1ae26f840e848f24503806e875a01979af6"} Jul 09 14:15:03.549604 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:03.549566 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" event={"ID":"ebf3f349-a077-487e-aa7b-ea11c258fc14","Type":"ContainerStarted","Data":"5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d"} Jul 09 14:15:03.566174 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:03.566123 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" podStartSLOduration=1.268592997 podStartE2EDuration="3.566107705s" totalImagesPullingTime="2.297514708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:15:03.565121996 +0000 UTC m=+1137.509729742" watchObservedRunningTime="2026-07-09 14:15:03.566107705 +0000 UTC m=+1137.510715485" Jul 09 14:15:06.144714 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:06.144674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:15:07.880938 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:07.880889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:15:16.552121 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:16.552081 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:15:40.370765 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:40.370727 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:15:50.654596 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:15:50.654560 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:16:00.011704 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:00.011661 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h"] Jul 09 14:16:00.012169 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:00.011869 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" podUID="ebf3f349-a077-487e-aa7b-ea11c258fc14" containerName="cleanup" containerID="cri-o://5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d" gracePeriod=30 Jul 09 14:16:05.754270 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:05.754231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:16:06.589911 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:06.584188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:16:06.593790 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:06.593750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:16:17.569831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:17.569793 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:16:27.880028 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:27.879992 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:16:30.209468 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.209430 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:16:30.228215 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.228190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7w8f\" (UniqueName: \"kubernetes.io/projected/ebf3f349-a077-487e-aa7b-ea11c258fc14-kube-api-access-w7w8f\") pod \"ebf3f349-a077-487e-aa7b-ea11c258fc14\" (UID: \"ebf3f349-a077-487e-aa7b-ea11c258fc14\") " Jul 09 14:16:30.230638 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.230603 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf3f349-a077-487e-aa7b-ea11c258fc14-kube-api-access-w7w8f" (OuterVolumeSpecName: "kube-api-access-w7w8f") pod "ebf3f349-a077-487e-aa7b-ea11c258fc14" (UID: "ebf3f349-a077-487e-aa7b-ea11c258fc14"). InnerVolumeSpecName "kube-api-access-w7w8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:16:30.328977 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.328884 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7w8f\" (UniqueName: \"kubernetes.io/projected/ebf3f349-a077-487e-aa7b-ea11c258fc14-kube-api-access-w7w8f\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:16:30.974936 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.974844 2559 generic.go:356] "Generic (PLEG): container finished" podID="ebf3f349-a077-487e-aa7b-ea11c258fc14" containerID="5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d" exitCode=137 Jul 09 14:16:30.974936 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.974892 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" Jul 09 14:16:30.974936 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.974923 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" event={"ID":"ebf3f349-a077-487e-aa7b-ea11c258fc14","Type":"ContainerDied","Data":"5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d"} Jul 09 14:16:30.975172 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.974980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h" event={"ID":"ebf3f349-a077-487e-aa7b-ea11c258fc14","Type":"ContainerDied","Data":"5a9b08954f0edd94f84da1c3e0b4b1ae26f840e848f24503806e875a01979af6"} Jul 09 14:16:30.975172 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.975003 2559 scope.go:117] "RemoveContainer" containerID="5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d" Jul 09 14:16:30.983812 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.983793 2559 scope.go:117] "RemoveContainer" containerID="5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d" Jul 09 14:16:30.984130 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:16:30.984113 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d\": container with ID starting with 5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d not found: ID does not exist" containerID="5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d" Jul 09 14:16:30.984180 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.984139 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d"} err="failed to get container status \"5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d\": rpc error: code = NotFound desc = could not find container \"5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d\": container with ID starting with 5bc42c9547f15c188e7bbaa57e38428fbacfec4445bd555f20328fbe49ea027d not found: ID does not exist" Jul 09 14:16:30.993931 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.993901 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h"] Jul 09 14:16:30.997982 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:30.997957 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-5p85h"] Jul 09 14:16:32.646330 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:32.646284 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebf3f349-a077-487e-aa7b-ea11c258fc14" path="/var/lib/kubelet/pods/ebf3f349-a077-487e-aa7b-ea11c258fc14/volumes" Jul 09 14:16:40.073121 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:16:40.073082 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:17:11.871860 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:11.871825 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x"] Jul 09 14:17:11.872304 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:11.872064 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" podUID="958974e8-8f79-44ca-8fff-064f902252a2" containerName="manager" containerID="cri-o://14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541" gracePeriod=10 Jul 09 14:17:16.021011 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.020988 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:17:16.112103 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.112067 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcsmd\" (UniqueName: \"kubernetes.io/projected/958974e8-8f79-44ca-8fff-064f902252a2-kube-api-access-gcsmd\") pod \"958974e8-8f79-44ca-8fff-064f902252a2\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " Jul 09 14:17:16.112292 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.112182 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/958974e8-8f79-44ca-8fff-064f902252a2-extensions-socket-volume\") pod \"958974e8-8f79-44ca-8fff-064f902252a2\" (UID: \"958974e8-8f79-44ca-8fff-064f902252a2\") " Jul 09 14:17:16.112605 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.112579 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/958974e8-8f79-44ca-8fff-064f902252a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "958974e8-8f79-44ca-8fff-064f902252a2" (UID: "958974e8-8f79-44ca-8fff-064f902252a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:17:16.114397 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.114378 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/958974e8-8f79-44ca-8fff-064f902252a2-kube-api-access-gcsmd" (OuterVolumeSpecName: "kube-api-access-gcsmd") pod "958974e8-8f79-44ca-8fff-064f902252a2" (UID: "958974e8-8f79-44ca-8fff-064f902252a2"). InnerVolumeSpecName "kube-api-access-gcsmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:17:16.193971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.193870 2559 generic.go:356] "Generic (PLEG): container finished" podID="958974e8-8f79-44ca-8fff-064f902252a2" containerID="14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541" exitCode=0 Jul 09 14:17:16.193971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.193912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" event={"ID":"958974e8-8f79-44ca-8fff-064f902252a2","Type":"ContainerDied","Data":"14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541"} Jul 09 14:17:16.193971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.193918 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" Jul 09 14:17:16.193971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.193964 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x" event={"ID":"958974e8-8f79-44ca-8fff-064f902252a2","Type":"ContainerDied","Data":"27dbc2aa85f08c097bc2ef2162eed9b1dc32290c3d7ecc68a11f43c107c89be4"} Jul 09 14:17:16.194314 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.193987 2559 scope.go:117] "RemoveContainer" containerID="14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541" Jul 09 14:17:16.204198 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.204181 2559 scope.go:117] "RemoveContainer" containerID="14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541" Jul 09 14:17:16.204488 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:17:16.204459 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541\": container with ID starting with 14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541 not found: ID does not exist" containerID="14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541" Jul 09 14:17:16.204604 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.204495 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541"} err="failed to get container status \"14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541\": rpc error: code = NotFound desc = could not find container \"14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541\": container with ID starting with 14dfe92d1ce189d9fc19ec4dcdfa1163450435685072d67f791284e04e1d1541 not found: ID does not exist" Jul 09 14:17:16.213273 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.213250 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcsmd\" (UniqueName: \"kubernetes.io/projected/958974e8-8f79-44ca-8fff-064f902252a2-kube-api-access-gcsmd\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:17:16.213273 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.213273 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/958974e8-8f79-44ca-8fff-064f902252a2-extensions-socket-volume\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:17:16.218203 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.218181 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x"] Jul 09 14:17:16.223541 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.223520 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlc4x"] Jul 09 14:17:16.646626 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:17:16.646594 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="958974e8-8f79-44ca-8fff-064f902252a2" path="/var/lib/kubelet/pods/958974e8-8f79-44ca-8fff-064f902252a2/volumes" Jul 09 14:18:13.115294 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115251 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd"] Jul 09 14:18:13.115786 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115670 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958974e8-8f79-44ca-8fff-064f902252a2" containerName="manager" Jul 09 14:18:13.115786 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115684 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="958974e8-8f79-44ca-8fff-064f902252a2" containerName="manager" Jul 09 14:18:13.115786 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115706 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf3f349-a077-487e-aa7b-ea11c258fc14" containerName="cleanup" Jul 09 14:18:13.115786 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115711 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf3f349-a077-487e-aa7b-ea11c258fc14" containerName="cleanup" Jul 09 14:18:13.115786 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115786 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf3f349-a077-487e-aa7b-ea11c258fc14" containerName="cleanup" Jul 09 14:18:13.115945 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.115794 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="958974e8-8f79-44ca-8fff-064f902252a2" containerName="manager" Jul 09 14:18:13.118094 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.118077 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.122512 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.122490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kxxnp\"" Jul 09 14:18:13.163744 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.163712 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd"] Jul 09 14:18:13.218912 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.218877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b70c3161-16cf-4597-8493-f0ca8a854329-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f52dd\" (UID: \"b70c3161-16cf-4597-8493-f0ca8a854329\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.219091 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.218917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmpvf\" (UniqueName: \"kubernetes.io/projected/b70c3161-16cf-4597-8493-f0ca8a854329-kube-api-access-nmpvf\") pod \"kuadrant-operator-controller-manager-86878c769f-f52dd\" (UID: \"b70c3161-16cf-4597-8493-f0ca8a854329\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.319834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.319800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b70c3161-16cf-4597-8493-f0ca8a854329-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f52dd\" (UID: \"b70c3161-16cf-4597-8493-f0ca8a854329\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.319834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.319838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmpvf\" (UniqueName: \"kubernetes.io/projected/b70c3161-16cf-4597-8493-f0ca8a854329-kube-api-access-nmpvf\") pod \"kuadrant-operator-controller-manager-86878c769f-f52dd\" (UID: \"b70c3161-16cf-4597-8493-f0ca8a854329\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.320221 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.320203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b70c3161-16cf-4597-8493-f0ca8a854329-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f52dd\" (UID: \"b70c3161-16cf-4597-8493-f0ca8a854329\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.334076 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.334043 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmpvf\" (UniqueName: \"kubernetes.io/projected/b70c3161-16cf-4597-8493-f0ca8a854329-kube-api-access-nmpvf\") pod \"kuadrant-operator-controller-manager-86878c769f-f52dd\" (UID: \"b70c3161-16cf-4597-8493-f0ca8a854329\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.428401 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.428313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:13.583743 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:13.583711 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd"] Jul 09 14:18:13.588026 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:18:13.587996 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70c3161_16cf_4597_8493_f0ca8a854329.slice/crio-462ac8d1a954bbe4372fd70de6295845bda7007f8dc44eccbd5fbf6a4c9fd2a4 WatchSource:0}: Error finding container 462ac8d1a954bbe4372fd70de6295845bda7007f8dc44eccbd5fbf6a4c9fd2a4: Status 404 returned error can't find the container with id 462ac8d1a954bbe4372fd70de6295845bda7007f8dc44eccbd5fbf6a4c9fd2a4 Jul 09 14:18:14.486109 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:14.486053 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" event={"ID":"b70c3161-16cf-4597-8493-f0ca8a854329","Type":"ContainerStarted","Data":"2c0c55ea41538c508979dddb46d59496cc8037110dfaab32ee6cfee81e0b135c"} Jul 09 14:18:14.486613 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:14.486175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" event={"ID":"b70c3161-16cf-4597-8493-f0ca8a854329","Type":"ContainerStarted","Data":"462ac8d1a954bbe4372fd70de6295845bda7007f8dc44eccbd5fbf6a4c9fd2a4"} Jul 09 14:18:14.486613 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:14.486208 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:14.526178 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:14.526119 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" podStartSLOduration=1.526095797 podStartE2EDuration="1.526095797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:18:14.525144301 +0000 UTC m=+1328.469752047" watchObservedRunningTime="2026-07-09 14:18:14.526095797 +0000 UTC m=+1328.470703549" Jul 09 14:18:25.493159 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:25.493116 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f52dd" Jul 09 14:18:35.479774 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:35.479696 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:18:47.101676 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:47.101639 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:18:56.089834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:18:56.089793 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:19:08.144798 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:19:08.144763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:19:20.054700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:19:20.054662 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:19:29.652009 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:19:29.651966 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:19:38.540165 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:19:38.540126 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:19:49.056724 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:19:49.056683 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:19:59.951708 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:19:59.951611 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:20:10.350908 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:10.350869 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:20:20.263713 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:20.263677 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:20:29.654179 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:29.654109 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:30.997807 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:30.997755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:40.377247 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:40.377209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:44.753574 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:44.753535 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:20:52.551309 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:20:52.551271 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:21:02.449685 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:02.449648 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:21:06.619750 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:06.619722 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:21:06.623345 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:06.623317 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:21:12.142511 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:12.142476 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:21:21.947919 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:21.947877 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:21:34.351528 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:34.351431 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:21:44.944218 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:44.944182 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:21:54.054601 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:21:54.054563 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:22:03.458055 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:03.458017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:22:14.349210 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:14.349174 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:22:23.449197 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:23.449157 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:22:36.651205 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:36.651169 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:22:37.420898 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:37.420858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:22:46.147123 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:46.147091 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:22:55.654734 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:22:55.654693 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:23:04.847468 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:04.847359 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:23:18.254454 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:18.254403 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:23:26.748586 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:26.748545 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:23:30.870835 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:30.870778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:38.947579 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:38.947547 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:23:47.872594 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:47.872558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:50.858639 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:23:50.858604 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:24:00.062397 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:00.062364 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:24:04.488789 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:04.488750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:04.589512 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:04.589474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:04.976819 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:04.976781 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:11.297027 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:11.296959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:11.406271 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:11.406237 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:11.560098 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:11.560010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:11.660869 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:11.660827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:12.910762 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:12.910702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:13.042709 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:13.042671 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:13.163588 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:13.163499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:13.531505 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:13.531433 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:13.642742 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:13.642698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:15.375297 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:15.375253 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:24:15.919303 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:15.919261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:17.739865 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:17.739828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.061640 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:18.061609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.156066 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:18.156028 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.420202 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:18.420108 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:19.565619 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:19.565586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:24.212039 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:24.212002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:24.312311 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:24.312273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:24.418607 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:24.418568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:24.517280 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:24.517236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:24.586063 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:24.586033 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:24:25.521877 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:25.521834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:25.922175 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:25.922079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:26.020269 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:26.020232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:26.120541 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:26.120502 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:26.471627 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:26.471593 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:26.566140 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:26.566063 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:27.741769 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:27.741737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:30.609835 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:30.609800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:31.129802 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:31.129766 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:36.803953 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:36.803917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:36.913228 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:36.913188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:39.270994 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:39.270958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:43.281720 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:43.281690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:43.387693 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:43.387661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:43.533031 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:43.532942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:43.645655 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:43.645619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:44.654553 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:44.654516 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:44.738149 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:44.738099 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:44.837097 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:44.837060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:45.324359 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:45.324323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:45.706034 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:45.705949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:45.851945 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:45.851913 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:46.899385 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:46.899346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:49.772217 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:49.772176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:50.125537 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:50.125429 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:50.220283 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:50.220247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:50.297245 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:50.297204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:53.355478 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:53.355347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:56.120348 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:56.120307 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:56.483466 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:56.483343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:57.141713 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:57.141677 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:57.322627 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:57.322589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:59.462955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:24:59.462921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:05.727454 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:05.727393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:05.839009 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:05.838980 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:05.950843 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:05.950811 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:06.051785 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:06.051753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:06.471701 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:06.471614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:32.463962 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:32.463925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:38.536527 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:38.536486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:38.652822 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:38.652779 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:38.749039 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:38.749003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:54.686506 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:25:54.686427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.551652 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:00.551575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.618786 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:00.618751 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.726138 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:00.726106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.820035 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:00.819937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:06.648899 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:06.648868 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:26:06.655371 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:06.655341 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:26:11.277749 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:11.277716 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:12.201184 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:12.201141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:18.253023 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:18.252974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:18.346349 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:18.346305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:18.463083 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:18.463030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:18.556800 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:18.556699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:19.391549 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:19.391505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:19.475850 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:19.475812 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:20.751629 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:20.751594 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:26:21.163171 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:21.163072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:27.411080 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:27.411039 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:27.495420 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:27.495386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:28.105084 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:28.105038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:28.247534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:28.247494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:26:34.506795 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:34.506760 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:34.613271 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:34.613231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:34.749407 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:34.749351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:35.125562 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:35.125530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:35.333118 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:35.333084 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:37.414485 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:37.414434 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:26:38.582275 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:38.582232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:38.721885 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:38.721850 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:38.816479 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:38.816426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:39.009537 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:39.009491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:39.461325 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:39.461232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:39.758678 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:39.758645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:43.053174 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:43.053133 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:43.837215 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:43.837176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:43.927276 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:43.927247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:44.348177 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:44.348149 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:47.553857 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:47.553820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:26:50.462348 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:50.462308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:50.563953 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:50.563903 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:50.904700 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:50.904660 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:51.276685 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:51.276650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:51.379866 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:51.379837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:54.651904 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:54.651866 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:26:57.393304 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:57.393262 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:58.081291 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:58.081254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:58.196694 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:58.196657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:58.360063 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:26:58.359958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.171889 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:04.171849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.252100 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:04.252062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.372804 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:04.372763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.471021 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:04.470923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.570778 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:04.570741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:10.675794 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:10.675752 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:10.801155 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:10.801119 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:17.434631 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:17.434594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:17.802773 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:17.802719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:17.964014 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:17.963978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:20.629973 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:20.629932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:20.750752 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:20.750706 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:20.929040 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:20.928943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:21.027568 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:21.027528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:21.416219 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:21.416186 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:21.516835 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:21.516796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:25.156760 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:25.156715 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:25.657042 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:25.656998 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:27:41.844345 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.844305 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv"] Jul 09 14:27:41.847959 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.847938 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:41.851579 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.851534 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bea9ff30\"/\"kube-root-ca.crt\"" Jul 09 14:27:41.851579 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.851540 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bea9ff30\"/\"default-dockercfg-njgqf\"" Jul 09 14:27:41.851824 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.851540 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bea9ff30\"/\"openshift-service-ca.crt\"" Jul 09 14:27:41.851824 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.851656 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bea9ff30\"/\"e2e-lifecycle-model-bea9ff30-kserve-self-signed-certs\"" Jul 09 14:27:41.856529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.856506 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv"] Jul 09 14:27:41.874244 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.874213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:41.960520 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.960490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-model-cache\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:41.960520 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.960525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tmp-dir\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:41.960732 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.960562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7mlz\" (UniqueName: \"kubernetes.io/projected/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-kube-api-access-m7mlz\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:41.960732 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.960597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-home\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:41.960732 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.960612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tls-certs\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:41.960732 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:41.960638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-dshm\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.061903 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.061865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7mlz\" (UniqueName: \"kubernetes.io/projected/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-kube-api-access-m7mlz\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.061903 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.061915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-home\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062123 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tls-certs\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062164 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-dshm\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062252 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-home\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062289 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-model-cache\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062323 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062298 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tmp-dir\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062526 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-model-cache\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.062659 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.062642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tmp-dir\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.064516 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.064492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-dshm\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.064809 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.064792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tls-certs\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.070526 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.070501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7mlz\" (UniqueName: \"kubernetes.io/projected/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-kube-api-access-m7mlz\") pod \"e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.158263 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.158173 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:42.225140 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.225082 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:42.306261 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.306030 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv"] Jul 09 14:27:42.308636 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:27:42.308606 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb31e5c0b_0ee5_4807_9555_1e714e75cb3b.slice/crio-d05ff74f9e681630b7cb87651fa9032b646d8e9029c0a30e50097f986e5466c7 WatchSource:0}: Error finding container d05ff74f9e681630b7cb87651fa9032b646d8e9029c0a30e50097f986e5466c7: Status 404 returned error can't find the container with id d05ff74f9e681630b7cb87651fa9032b646d8e9029c0a30e50097f986e5466c7 Jul 09 14:27:42.309214 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:42.309176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:43.151758 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:43.151716 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:43.251275 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:43.251241 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" event={"ID":"b31e5c0b-0ee5-4807-9555-1e714e75cb3b","Type":"ContainerStarted","Data":"57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660"} Jul 09 14:27:43.251485 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:43.251283 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" event={"ID":"b31e5c0b-0ee5-4807-9555-1e714e75cb3b","Type":"ContainerStarted","Data":"d05ff74f9e681630b7cb87651fa9032b646d8e9029c0a30e50097f986e5466c7"} Jul 09 14:27:43.252692 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:43.252665 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:43.273791 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:43.273745 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" podStartSLOduration=2.273730412 podStartE2EDuration="2.273730412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:27:43.272307184 +0000 UTC m=+1897.216914930" watchObservedRunningTime="2026-07-09 14:27:43.273730412 +0000 UTC m=+1897.218338156" Jul 09 14:27:44.757303 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:44.757271 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:27:52.158704 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:52.158666 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:52.159133 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:52.158717 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:52.172211 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:52.172175 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:27:52.309798 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:27:52.309764 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:28:02.557615 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:02.557585 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:28:07.888922 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:07.888879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:08.352357 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:08.352316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:13.143424 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:13.143391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:28:14.033095 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:14.033059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:19.005253 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:19.005215 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv"] Jul 09 14:28:19.098297 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:19.098228 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:22.458767 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:22.458735 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:28:34.026398 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.026359 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" podUID="b31e5c0b-0ee5-4807-9555-1e714e75cb3b" containerName="main" containerID="cri-o://57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660" gracePeriod=45 Jul 09 14:28:34.269688 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.269665 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:28:34.359321 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359230 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-dshm\") pod \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " Jul 09 14:28:34.359321 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359287 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tls-certs\") pod \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " Jul 09 14:28:34.359564 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359324 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-model-cache\") pod \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " Jul 09 14:28:34.359564 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359356 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7mlz\" (UniqueName: \"kubernetes.io/projected/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-kube-api-access-m7mlz\") pod \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " Jul 09 14:28:34.359564 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359408 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tmp-dir\") pod \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " Jul 09 14:28:34.359564 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359473 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-home\") pod \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\" (UID: \"b31e5c0b-0ee5-4807-9555-1e714e75cb3b\") " Jul 09 14:28:34.359770 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359620 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-model-cache" (OuterVolumeSpecName: "model-cache") pod "b31e5c0b-0ee5-4807-9555-1e714e75cb3b" (UID: "b31e5c0b-0ee5-4807-9555-1e714e75cb3b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:34.359770 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359720 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b31e5c0b-0ee5-4807-9555-1e714e75cb3b" (UID: "b31e5c0b-0ee5-4807-9555-1e714e75cb3b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:34.359770 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359767 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:28:34.359920 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.359867 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-home" (OuterVolumeSpecName: "home") pod "b31e5c0b-0ee5-4807-9555-1e714e75cb3b" (UID: "b31e5c0b-0ee5-4807-9555-1e714e75cb3b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:34.361688 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.361655 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-dshm" (OuterVolumeSpecName: "dshm") pod "b31e5c0b-0ee5-4807-9555-1e714e75cb3b" (UID: "b31e5c0b-0ee5-4807-9555-1e714e75cb3b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:34.361809 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.361704 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-kube-api-access-m7mlz" (OuterVolumeSpecName: "kube-api-access-m7mlz") pod "b31e5c0b-0ee5-4807-9555-1e714e75cb3b" (UID: "b31e5c0b-0ee5-4807-9555-1e714e75cb3b"). InnerVolumeSpecName "kube-api-access-m7mlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:28:34.361809 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.361726 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b31e5c0b-0ee5-4807-9555-1e714e75cb3b" (UID: "b31e5c0b-0ee5-4807-9555-1e714e75cb3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:28:34.461117 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.461077 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:28:34.461117 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.461111 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:28:34.461117 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.461122 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:28:34.461117 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.461130 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:28:34.461392 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.461138 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7mlz\" (UniqueName: \"kubernetes.io/projected/b31e5c0b-0ee5-4807-9555-1e714e75cb3b-kube-api-access-m7mlz\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:28:34.508630 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.508596 2559 generic.go:356] "Generic (PLEG): container finished" podID="b31e5c0b-0ee5-4807-9555-1e714e75cb3b" containerID="57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660" exitCode=0 Jul 09 14:28:34.508817 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.508635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" event={"ID":"b31e5c0b-0ee5-4807-9555-1e714e75cb3b","Type":"ContainerDied","Data":"57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660"} Jul 09 14:28:34.508817 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.508643 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" Jul 09 14:28:34.508817 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.508668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv" event={"ID":"b31e5c0b-0ee5-4807-9555-1e714e75cb3b","Type":"ContainerDied","Data":"d05ff74f9e681630b7cb87651fa9032b646d8e9029c0a30e50097f986e5466c7"} Jul 09 14:28:34.508817 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.508689 2559 scope.go:117] "RemoveContainer" containerID="57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660" Jul 09 14:28:34.518224 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.518204 2559 scope.go:117] "RemoveContainer" containerID="57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660" Jul 09 14:28:34.518503 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:28:34.518481 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660\": container with ID starting with 57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660 not found: ID does not exist" containerID="57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660" Jul 09 14:28:34.518593 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.518513 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660"} err="failed to get container status \"57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660\": rpc error: code = NotFound desc = could not find container \"57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660\": container with ID starting with 57e51b6a1037a661e77e2308a9328c76d76a8e2df2728d233cf19ed7b3d76660 not found: ID does not exist" Jul 09 14:28:34.530638 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.530617 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv"] Jul 09 14:28:34.535540 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.535518 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-bea9ff30/e2e-lifecycle-model-bea9ff30-kserve-df898d7d7-94dsv"] Jul 09 14:28:34.646554 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:34.646475 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31e5c0b-0ee5-4807-9555-1e714e75cb3b" path="/var/lib/kubelet/pods/b31e5c0b-0ee5-4807-9555-1e714e75cb3b/volumes" Jul 09 14:28:55.914383 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:55.914341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:56.421811 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:56.421775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:58.851814 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:28:58.851780 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:29:02.109605 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:02.109565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:02.210681 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:02.210646 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:02.415867 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:02.415779 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:03.756587 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:03.756549 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:03.851582 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:03.851540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:03.951098 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:03.951064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:04.699246 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:04.699197 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:04.802194 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:04.802163 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:04.899324 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:04.899270 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:06.297318 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:06.297260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:08.647075 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:08.647046 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:29:12.276107 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:12.276067 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:12.379219 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:12.379171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:13.051305 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:13.051265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:19.101752 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:19.101718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:19.226860 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:19.226820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:19.335395 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:19.335357 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:20.552387 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:20.552350 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:29:30.041286 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:30.041248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:30.438676 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:30.438591 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:51.665943 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:51.665902 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:57.929390 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:57.929352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:58.007728 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:58.007690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:58.353581 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:58.353542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:58.848501 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:58.848465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:58.933382 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:29:58.933312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:00.134762 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.134722 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr"] Jul 09 14:30:00.135159 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.135099 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31e5c0b-0ee5-4807-9555-1e714e75cb3b" containerName="main" Jul 09 14:30:00.135159 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.135110 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31e5c0b-0ee5-4807-9555-1e714e75cb3b" containerName="main" Jul 09 14:30:00.135246 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.135190 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31e5c0b-0ee5-4807-9555-1e714e75cb3b" containerName="main" Jul 09 14:30:00.138345 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.138325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:30:00.142191 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.142159 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 14:30:00.142191 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.142159 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-thdg4\"" Jul 09 14:30:00.142971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.142951 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 14:30:00.146731 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.146706 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr"] Jul 09 14:30:00.184939 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.184903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp6nt\" (UniqueName: \"kubernetes.io/projected/971fd1b4-1aa1-48f9-b585-5bc2da50a00e-kube-api-access-gp6nt\") pod \"maas-api-key-cleanup-29726790-ljcsr\" (UID: \"971fd1b4-1aa1-48f9-b585-5bc2da50a00e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:30:00.285903 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.285858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp6nt\" (UniqueName: \"kubernetes.io/projected/971fd1b4-1aa1-48f9-b585-5bc2da50a00e-kube-api-access-gp6nt\") pod \"maas-api-key-cleanup-29726790-ljcsr\" (UID: \"971fd1b4-1aa1-48f9-b585-5bc2da50a00e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:30:00.295860 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.295822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp6nt\" (UniqueName: \"kubernetes.io/projected/971fd1b4-1aa1-48f9-b585-5bc2da50a00e-kube-api-access-gp6nt\") pod \"maas-api-key-cleanup-29726790-ljcsr\" (UID: \"971fd1b4-1aa1-48f9-b585-5bc2da50a00e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:30:00.450212 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.450116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:30:00.590589 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.590389 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr"] Jul 09 14:30:00.593670 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:30:00.593640 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971fd1b4_1aa1_48f9_b585_5bc2da50a00e.slice/crio-acb38be3ae930583d729e5c439c6de51055fb420311e780826af6d0b2a873ca4 WatchSource:0}: Error finding container acb38be3ae930583d729e5c439c6de51055fb420311e780826af6d0b2a873ca4: Status 404 returned error can't find the container with id acb38be3ae930583d729e5c439c6de51055fb420311e780826af6d0b2a873ca4 Jul 09 14:30:00.939379 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:00.939347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" event={"ID":"971fd1b4-1aa1-48f9-b585-5bc2da50a00e","Type":"ContainerStarted","Data":"acb38be3ae930583d729e5c439c6de51055fb420311e780826af6d0b2a873ca4"} Jul 09 14:30:01.854349 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:01.854300 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:01.947262 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:01.947228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" event={"ID":"971fd1b4-1aa1-48f9-b585-5bc2da50a00e","Type":"ContainerStarted","Data":"d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359"} Jul 09 14:30:01.974587 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:01.974536 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" podStartSLOduration=1.974519957 podStartE2EDuration="1.974519957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:01.974317653 +0000 UTC m=+2035.918925399" watchObservedRunningTime="2026-07-09 14:30:01.974519957 +0000 UTC m=+2035.919127705" Jul 09 14:30:02.002107 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:02.002065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:02.105539 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:02.105425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:02.826675 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:02.826640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:02.927129 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:02.927091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:06.515517 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:06.515482 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:06.956775 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:06.956678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:07.344071 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:07.344034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:07.559149 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:07.559108 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:07.657238 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:07.657156 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:30:10.964470 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:10.964409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:11.059406 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:11.059376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:11.273518 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:11.273468 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:11.563937 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:11.563849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:11.897608 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:11.897521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:11.996210 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:11.996171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:12.095960 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:12.095920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:15.613669 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:15.613631 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:16.339975 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:16.339943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:16.355221 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:16.355179 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:30:16.440094 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:16.440065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:23.493558 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:23.493515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:23.593159 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:23.593104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:25.293839 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:25.293795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:30.012275 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:30.012186 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:30:32.770222 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:32.770189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:32.887205 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:32.887167 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:56.572013 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:56.571973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:58.045852 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.045814 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf"] Jul 09 14:30:58.049581 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.049558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.052299 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.052274 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f1a2e7\"/\"kube-root-ca.crt\"" Jul 09 14:30:58.053334 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.053313 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f1a2e7\"/\"test-model-f1a2e7-kserve-self-signed-certs\"" Jul 09 14:30:58.053481 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.053335 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f1a2e7\"/\"default-dockercfg-9cr4z\"" Jul 09 14:30:58.053481 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.053320 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f1a2e7\"/\"openshift-service-ca.crt\"" Jul 09 14:30:58.069818 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.069696 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf"] Jul 09 14:30:58.101702 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.101644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-dshm\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.101702 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.101687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-tmp-dir\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.101702 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.101721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-home\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.101977 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.101787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-model-cache\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.101977 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.101816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgs6\" (UniqueName: \"kubernetes.io/projected/bf28f3f6-73d8-4d93-8362-26036372ef19-kube-api-access-7jgs6\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.101977 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.101834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf28f3f6-73d8-4d93-8362-26036372ef19-tls-certs\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.202606 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.202568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-dshm\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.202606 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.202610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-tmp-dir\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.202869 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.202648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-home\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.202869 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.202696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-model-cache\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.202869 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.202721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgs6\" (UniqueName: \"kubernetes.io/projected/bf28f3f6-73d8-4d93-8362-26036372ef19-kube-api-access-7jgs6\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.202869 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.202745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf28f3f6-73d8-4d93-8362-26036372ef19-tls-certs\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.203127 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.203104 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-tmp-dir\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.203200 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.203156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-home\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.203250 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.203204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-model-cache\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.205243 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.205224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf28f3f6-73d8-4d93-8362-26036372ef19-tls-certs\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.205347 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.205232 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-dshm\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.212336 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.212311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgs6\" (UniqueName: \"kubernetes.io/projected/bf28f3f6-73d8-4d93-8362-26036372ef19-kube-api-access-7jgs6\") pod \"test-model-f1a2e7-kserve-5f4c46798f-88ksf\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.358606 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.358512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:30:58.396094 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.396060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:58.498073 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:58.498049 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf"] Jul 09 14:30:58.501055 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:30:58.501024 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf28f3f6_73d8_4d93_8362_26036372ef19.slice/crio-9c5ed0e746a9f5e63a61bd9719e3d27466275e135993fb5bb82c309334d7d4cf WatchSource:0}: Error finding container 9c5ed0e746a9f5e63a61bd9719e3d27466275e135993fb5bb82c309334d7d4cf: Status 404 returned error can't find the container with id 9c5ed0e746a9f5e63a61bd9719e3d27466275e135993fb5bb82c309334d7d4cf Jul 09 14:30:59.233967 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:59.233929 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" event={"ID":"bf28f3f6-73d8-4d93-8362-26036372ef19","Type":"ContainerStarted","Data":"8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157"} Jul 09 14:30:59.234343 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:59.233976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" event={"ID":"bf28f3f6-73d8-4d93-8362-26036372ef19","Type":"ContainerStarted","Data":"9c5ed0e746a9f5e63a61bd9719e3d27466275e135993fb5bb82c309334d7d4cf"} Jul 09 14:30:59.254788 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:30:59.254743 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" podStartSLOduration=1.254729221 podStartE2EDuration="1.254729221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:59.253641023 +0000 UTC m=+2093.198248768" watchObservedRunningTime="2026-07-09 14:30:59.254729221 +0000 UTC m=+2093.199336966" Jul 09 14:31:00.013276 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:00.013232 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr"] Jul 09 14:31:00.013518 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:00.013492 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" podUID="971fd1b4-1aa1-48f9-b585-5bc2da50a00e" containerName="cleanup" containerID="cri-o://d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359" gracePeriod=30 Jul 09 14:31:02.080695 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:02.080653 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:31:06.677155 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:06.677129 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:31:06.685750 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:06.685724 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:31:08.358990 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:08.358941 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:31:08.359506 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:08.359012 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:31:08.371326 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:08.371301 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:31:09.292897 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:09.292870 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:31:19.965032 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:19.964978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:20.880571 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:20.880535 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf"] Jul 09 14:31:20.939301 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:20.939257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:21.059606 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:21.059563 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:21.497149 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:21.497116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:21.665940 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:21.665906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:21.793277 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:21.793189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:22.016353 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:22.016315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:26.541965 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:26.541924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:26.846398 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:26.846309 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:31:30.195909 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.195877 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:31:30.288675 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.288566 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp6nt\" (UniqueName: \"kubernetes.io/projected/971fd1b4-1aa1-48f9-b585-5bc2da50a00e-kube-api-access-gp6nt\") pod \"971fd1b4-1aa1-48f9-b585-5bc2da50a00e\" (UID: \"971fd1b4-1aa1-48f9-b585-5bc2da50a00e\") " Jul 09 14:31:30.291062 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.291033 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971fd1b4-1aa1-48f9-b585-5bc2da50a00e-kube-api-access-gp6nt" (OuterVolumeSpecName: "kube-api-access-gp6nt") pod "971fd1b4-1aa1-48f9-b585-5bc2da50a00e" (UID: "971fd1b4-1aa1-48f9-b585-5bc2da50a00e"). InnerVolumeSpecName "kube-api-access-gp6nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:30.388892 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.388859 2559 generic.go:356] "Generic (PLEG): container finished" podID="971fd1b4-1aa1-48f9-b585-5bc2da50a00e" containerID="d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359" exitCode=137 Jul 09 14:31:30.389072 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.388906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" event={"ID":"971fd1b4-1aa1-48f9-b585-5bc2da50a00e","Type":"ContainerDied","Data":"d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359"} Jul 09 14:31:30.389072 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.388969 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" event={"ID":"971fd1b4-1aa1-48f9-b585-5bc2da50a00e","Type":"ContainerDied","Data":"acb38be3ae930583d729e5c439c6de51055fb420311e780826af6d0b2a873ca4"} Jul 09 14:31:30.389072 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.388992 2559 scope.go:117] "RemoveContainer" containerID="d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359" Jul 09 14:31:30.389072 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.388913 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr" Jul 09 14:31:30.389526 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.389481 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp6nt\" (UniqueName: \"kubernetes.io/projected/971fd1b4-1aa1-48f9-b585-5bc2da50a00e-kube-api-access-gp6nt\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:30.397953 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.397933 2559 scope.go:117] "RemoveContainer" containerID="d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359" Jul 09 14:31:30.398216 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:31:30.398197 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359\": container with ID starting with d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359 not found: ID does not exist" containerID="d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359" Jul 09 14:31:30.398289 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.398223 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359"} err="failed to get container status \"d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359\": rpc error: code = NotFound desc = could not find container \"d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359\": container with ID starting with d0bde9785b97b70e0401b1892e80203a575d49946b0907f9712b127cb1e18359 not found: ID does not exist" Jul 09 14:31:30.418722 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.418548 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr"] Jul 09 14:31:30.424715 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.424693 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-ljcsr"] Jul 09 14:31:30.647420 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:30.647341 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971fd1b4-1aa1-48f9-b585-5bc2da50a00e" path="/var/lib/kubelet/pods/971fd1b4-1aa1-48f9-b585-5bc2da50a00e/volumes" Jul 09 14:31:35.901214 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:35.901171 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" podUID="bf28f3f6-73d8-4d93-8362-26036372ef19" containerName="main" containerID="cri-o://8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157" gracePeriod=45 Jul 09 14:31:36.164647 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.164587 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:31:36.237570 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237535 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-home\") pod \"bf28f3f6-73d8-4d93-8362-26036372ef19\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " Jul 09 14:31:36.237570 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237574 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jgs6\" (UniqueName: \"kubernetes.io/projected/bf28f3f6-73d8-4d93-8362-26036372ef19-kube-api-access-7jgs6\") pod \"bf28f3f6-73d8-4d93-8362-26036372ef19\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " Jul 09 14:31:36.237831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237594 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-model-cache\") pod \"bf28f3f6-73d8-4d93-8362-26036372ef19\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " Jul 09 14:31:36.237831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237623 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf28f3f6-73d8-4d93-8362-26036372ef19-tls-certs\") pod \"bf28f3f6-73d8-4d93-8362-26036372ef19\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " Jul 09 14:31:36.237831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237656 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-tmp-dir\") pod \"bf28f3f6-73d8-4d93-8362-26036372ef19\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " Jul 09 14:31:36.237831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237705 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-dshm\") pod \"bf28f3f6-73d8-4d93-8362-26036372ef19\" (UID: \"bf28f3f6-73d8-4d93-8362-26036372ef19\") " Jul 09 14:31:36.238047 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237885 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-home" (OuterVolumeSpecName: "home") pod "bf28f3f6-73d8-4d93-8362-26036372ef19" (UID: "bf28f3f6-73d8-4d93-8362-26036372ef19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:36.238047 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.237904 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf28f3f6-73d8-4d93-8362-26036372ef19" (UID: "bf28f3f6-73d8-4d93-8362-26036372ef19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:36.238153 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.238103 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf28f3f6-73d8-4d93-8362-26036372ef19" (UID: "bf28f3f6-73d8-4d93-8362-26036372ef19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:36.240061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.240034 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-dshm" (OuterVolumeSpecName: "dshm") pod "bf28f3f6-73d8-4d93-8362-26036372ef19" (UID: "bf28f3f6-73d8-4d93-8362-26036372ef19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:36.240061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.240048 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf28f3f6-73d8-4d93-8362-26036372ef19-kube-api-access-7jgs6" (OuterVolumeSpecName: "kube-api-access-7jgs6") pod "bf28f3f6-73d8-4d93-8362-26036372ef19" (UID: "bf28f3f6-73d8-4d93-8362-26036372ef19"). InnerVolumeSpecName "kube-api-access-7jgs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:36.240211 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.240054 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf28f3f6-73d8-4d93-8362-26036372ef19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf28f3f6-73d8-4d93-8362-26036372ef19" (UID: "bf28f3f6-73d8-4d93-8362-26036372ef19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:31:36.338527 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.338490 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:36.338527 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.338520 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jgs6\" (UniqueName: \"kubernetes.io/projected/bf28f3f6-73d8-4d93-8362-26036372ef19-kube-api-access-7jgs6\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:36.338527 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.338531 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:36.338767 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.338540 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf28f3f6-73d8-4d93-8362-26036372ef19-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:36.338767 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.338551 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:36.338767 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.338558 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf28f3f6-73d8-4d93-8362-26036372ef19-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:31:36.420262 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.420169 2559 generic.go:356] "Generic (PLEG): container finished" podID="bf28f3f6-73d8-4d93-8362-26036372ef19" containerID="8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157" exitCode=0 Jul 09 14:31:36.420262 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.420219 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" Jul 09 14:31:36.420487 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.420254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" event={"ID":"bf28f3f6-73d8-4d93-8362-26036372ef19","Type":"ContainerDied","Data":"8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157"} Jul 09 14:31:36.420487 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.420298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf" event={"ID":"bf28f3f6-73d8-4d93-8362-26036372ef19","Type":"ContainerDied","Data":"9c5ed0e746a9f5e63a61bd9719e3d27466275e135993fb5bb82c309334d7d4cf"} Jul 09 14:31:36.420487 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.420315 2559 scope.go:117] "RemoveContainer" containerID="8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157" Jul 09 14:31:36.430004 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.429986 2559 scope.go:117] "RemoveContainer" containerID="8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157" Jul 09 14:31:36.430302 ip-10-0-136-155 kubenswrapper[2559]: E0709 14:31:36.430282 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157\": container with ID starting with 8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157 not found: ID does not exist" containerID="8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157" Jul 09 14:31:36.430359 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.430312 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157"} err="failed to get container status \"8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157\": rpc error: code = NotFound desc = could not find container \"8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157\": container with ID starting with 8f78e07e57f6dc2dbb8f2814155e732701313185de1bc79584509eba3779b157 not found: ID does not exist" Jul 09 14:31:36.447170 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.447133 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf"] Jul 09 14:31:36.452483 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.452456 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f1a2e7/test-model-f1a2e7-kserve-5f4c46798f-88ksf"] Jul 09 14:31:36.647520 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:36.647486 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf28f3f6-73d8-4d93-8362-26036372ef19" path="/var/lib/kubelet/pods/bf28f3f6-73d8-4d93-8362-26036372ef19/volumes" Jul 09 14:31:45.340061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:45.339951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:57.426214 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:31:57.426128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:03.977239 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:03.977189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:04.245540 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:04.245417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:04.639760 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:04.639669 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:05.051149 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:05.051113 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:05.149020 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:05.148986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:05.531679 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:05.531648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:05.631629 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:05.631594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:08.250584 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:08.250544 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:32:11.193029 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:11.192997 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:11.288930 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:11.288892 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:11.451892 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:11.451800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:12.116504 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:12.116465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:12.415897 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:12.415794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:12.647122 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:12.647052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:15.433389 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:15.433356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:15.557861 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:15.557820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:15.914300 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:15.914262 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:16.011765 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:16.011728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:16.327254 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:16.327220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:16.427834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:16.427798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:19.937788 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:19.937743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:20.424093 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:20.424050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:20.727562 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:20.727482 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:21.217831 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:21.217795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:23.470834 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:23.470797 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:32:23.516958 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:23.516923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:23.622358 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:23.622317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:23.715278 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:23.715240 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:24.167257 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:24.167218 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:24.266304 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:24.266271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:24.684307 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:24.684271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:27.995989 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:27.995955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:36.266230 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:36.266192 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:36.510622 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:36.510579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:36.634955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:36.634863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:36.728170 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:36.728132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:37.025704 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:37.025670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:40.565021 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:40.564984 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:32:43.054833 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:43.054795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:43.154578 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:43.154545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:43.258416 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:43.258372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:43.426257 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:43.426160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:43.958028 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:43.957995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:44.363192 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:44.363161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:44.520045 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:44.520009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:44.620146 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:44.620047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:44.822587 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:44.822555 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:50.262746 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:50.262711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:50.359322 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:50.359284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:50.510854 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:50.510818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:51.065782 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:51.065747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:51.381505 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:51.381406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:51.639971 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:51.639879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:53.850713 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:53.850674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:32:54.699361 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:54.699319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:54.798771 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:54.798738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:54.907640 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:54.907592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:55.095204 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:55.095175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:55.289672 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:55.289617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:55.386045 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:55.385944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:59.191842 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:59.191806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:59.531912 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:59.531869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:59.874402 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:32:59.874310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:00.190563 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:00.190434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:02.817652 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:02.817621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:02.943158 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:02.943124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.063270 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:03.063239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.201221 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:03.201135 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.584269 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:03.584228 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.684967 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:03.684929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:05.855724 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:05.855691 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:33:07.299479 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:07.299415 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:16.297855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:16.297817 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:16.400529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:16.400490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:17.083457 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:17.083393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:33:25.924061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:25.924025 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:26.024794 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:33:26.024756 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:14.501310 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:34:14.501271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:03.239177 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:35:03.239086 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:14.618963 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:35:14.618927 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:24.097871 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:35:24.097831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:50.539912 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:35:50.539877 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:06.706010 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:06.705978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:36:06.718210 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:06.718186 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:36:12.173314 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:12.173271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:13.350707 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:13.350668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:16.050818 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:16.050787 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:36:18.653228 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:18.653184 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:18.719428 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:18.719388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:18.940915 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:18.940824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:19.326865 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:19.326825 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:19.746842 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:19.746804 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:19.847507 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:19.847475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:19.945705 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:19.945662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:20.051377 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:20.051297 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:25.643516 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:25.643478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:25.717534 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:25.717505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:25.908132 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:25.908045 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:28.250543 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:28.250502 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkmfb"] Jul 09 14:36:28.749325 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:28.749288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:28.850517 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:28.850475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:31.318621 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:31.318584 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-47rnb_847d128f-9bc6-4727-a5be-298e31d5cb76/manager/0.log" Jul 09 14:36:31.663745 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:31.663646 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k7bs9_761db452-a7a0-4685-b656-e48eb8112826/server/0.log" Jul 09 14:36:31.789196 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:31.789141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ptzrp_0833b610-37d9-43b8-8498-abdb43a044a0/manager/0.log" Jul 09 14:36:31.895038 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:31.895007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74b946fd-nzmvd_64301805-e75c-4184-b03d-1e3a202b4caf/copy-manifests/0.log" Jul 09 14:36:31.902763 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:31.902738 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74b946fd-nzmvd_64301805-e75c-4184-b03d-1e3a202b4caf/manager/0.log" Jul 09 14:36:33.655744 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:33.655710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jnpzd_7667926d-241a-4f22-81d4-78fa20e6901a/manager/0.log" Jul 09 14:36:33.769679 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:33.769645 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wz7jh_44c8297f-1897-49d0-8c1c-13f40c39f051/manager/0.log" Jul 09 14:36:34.019217 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:34.019185 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-72x57_2c6ecf82-0da5-41fb-8870-0dbbab06d7f1/registry-server/0.log" Jul 09 14:36:34.138698 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:34.138662 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-f52dd_b70c3161-16cf-4597-8493-f0ca8a854329/manager/0.log" Jul 09 14:36:34.256435 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:34.256403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fkmfb_3642cc0f-5497-4bf8-be5f-b6a03d950d53/limitador/0.log" Jul 09 14:36:34.858099 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:34.858067 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zv7fd_c2001523-c366-427d-b82a-cadcffc6787a/discovery/0.log" Jul 09 14:36:34.976191 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:34.976160 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f974f5cb9-22twv_8cf815ed-0d80-4dc2-b027-6d906f1376bf/kube-auth-proxy/0.log" Jul 09 14:36:36.122222 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:36.122187 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2xmws_c78016d0-5f78-4756-b35f-743f0b49d672/main/0.log" Jul 09 14:36:40.249906 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:40.249863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:40.344158 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:40.344120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:43.333293 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:43.333255 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zl2xb_49015798-f028-4b8e-a453-42dd0514db68/global-pull-secret-syncer/0.log" Jul 09 14:36:43.398711 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:43.398673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2rhl9_7d1673cd-05fb-47a9-8e27-6d5edb1d669f/konnectivity-agent/0.log" Jul 09 14:36:43.554651 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:43.554621 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-155.ec2.internal_34d1f1a8876ffc091a8781eb04b08c52/haproxy/0.log" Jul 09 14:36:48.936151 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:48.936119 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jnpzd_7667926d-241a-4f22-81d4-78fa20e6901a/manager/0.log" Jul 09 14:36:48.965582 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:48.965550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wz7jh_44c8297f-1897-49d0-8c1c-13f40c39f051/manager/0.log" Jul 09 14:36:49.045936 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:49.045900 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-72x57_2c6ecf82-0da5-41fb-8870-0dbbab06d7f1/registry-server/0.log" Jul 09 14:36:49.190139 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:49.190035 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-f52dd_b70c3161-16cf-4597-8493-f0ca8a854329/manager/0.log" Jul 09 14:36:49.213667 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:49.213635 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fkmfb_3642cc0f-5497-4bf8-be5f-b6a03d950d53/limitador/0.log" Jul 09 14:36:51.382566 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:51.382524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-bb5gn_4dd010ab-2ca8-40cf-a269-dd839682c4d5/monitoring-plugin/0.log" Jul 09 14:36:51.516863 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:51.516831 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gxn7f_f42df821-1e67-4c45-87e4-520dd9ceb7ca/node-exporter/0.log" Jul 09 14:36:51.540737 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:51.540707 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gxn7f_f42df821-1e67-4c45-87e4-520dd9ceb7ca/kube-rbac-proxy/0.log" Jul 09 14:36:51.567529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:51.567499 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gxn7f_f42df821-1e67-4c45-87e4-520dd9ceb7ca/init-textfile/0.log" Jul 09 14:36:52.158344 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:52.158297 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7d4bbb4f-vjxk7_8428a350-eda3-4be0-b289-5498cc6dea00/thanos-query/0.log" Jul 09 14:36:52.183173 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:52.183141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7d4bbb4f-vjxk7_8428a350-eda3-4be0-b289-5498cc6dea00/kube-rbac-proxy-web/0.log" Jul 09 14:36:52.208008 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:52.207978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7d4bbb4f-vjxk7_8428a350-eda3-4be0-b289-5498cc6dea00/kube-rbac-proxy/0.log" Jul 09 14:36:52.230955 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:52.230918 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7d4bbb4f-vjxk7_8428a350-eda3-4be0-b289-5498cc6dea00/prom-label-proxy/0.log" Jul 09 14:36:52.257839 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:52.257812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7d4bbb4f-vjxk7_8428a350-eda3-4be0-b289-5498cc6dea00/kube-rbac-proxy-rules/0.log" Jul 09 14:36:52.284781 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:52.284751 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7d4bbb4f-vjxk7_8428a350-eda3-4be0-b289-5498cc6dea00/kube-rbac-proxy-metrics/0.log" Jul 09 14:36:53.055365 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055328 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd"] Jul 09 14:36:53.055855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055718 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf28f3f6-73d8-4d93-8362-26036372ef19" containerName="main" Jul 09 14:36:53.055855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055731 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf28f3f6-73d8-4d93-8362-26036372ef19" containerName="main" Jul 09 14:36:53.055855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055762 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971fd1b4-1aa1-48f9-b585-5bc2da50a00e" containerName="cleanup" Jul 09 14:36:53.055855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055767 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="971fd1b4-1aa1-48f9-b585-5bc2da50a00e" containerName="cleanup" Jul 09 14:36:53.055855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055828 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="971fd1b4-1aa1-48f9-b585-5bc2da50a00e" containerName="cleanup" Jul 09 14:36:53.055855 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.055836 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf28f3f6-73d8-4d93-8362-26036372ef19" containerName="main" Jul 09 14:36:53.059010 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.058993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.061717 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.061697 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fq7xw\"/\"openshift-service-ca.crt\"" Jul 09 14:36:53.062697 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.062666 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fq7xw\"/\"kube-root-ca.crt\"" Jul 09 14:36:53.062818 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.062740 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fq7xw\"/\"default-dockercfg-vd84f\"" Jul 09 14:36:53.068940 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.068913 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd"] Jul 09 14:36:53.184372 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.184335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-sys\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.184372 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.184375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-lib-modules\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.184636 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.184496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm7lc\" (UniqueName: \"kubernetes.io/projected/0e39a9c5-e364-45cf-a835-719f2a914c5e-kube-api-access-xm7lc\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.184636 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.184559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-proc\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.184636 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.184592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-podres\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285321 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-podres\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285375 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-sys\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-lib-modules\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm7lc\" (UniqueName: \"kubernetes.io/projected/0e39a9c5-e364-45cf-a835-719f2a914c5e-kube-api-access-xm7lc\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285529 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-podres\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285673 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-proc\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285673 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-sys\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285673 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-lib-modules\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.285673 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.285587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e39a9c5-e364-45cf-a835-719f2a914c5e-proc\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.295157 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.295129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm7lc\" (UniqueName: \"kubernetes.io/projected/0e39a9c5-e364-45cf-a835-719f2a914c5e-kube-api-access-xm7lc\") pod \"perf-node-gather-daemonset-664jd\" (UID: \"0e39a9c5-e364-45cf-a835-719f2a914c5e\") " pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.369694 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.369593 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:53.507192 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.507149 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd"] Jul 09 14:36:53.511009 ip-10-0-136-155 kubenswrapper[2559]: W0709 14:36:53.510967 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0e39a9c5_e364_45cf_a835_719f2a914c5e.slice/crio-d61ceda65e8cd766f4388b080453b11092780bd85413cdf3b062394c465bb227 WatchSource:0}: Error finding container d61ceda65e8cd766f4388b080453b11092780bd85413cdf3b062394c465bb227: Status 404 returned error can't find the container with id d61ceda65e8cd766f4388b080453b11092780bd85413cdf3b062394c465bb227 Jul 09 14:36:53.995474 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.995421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" event={"ID":"0e39a9c5-e364-45cf-a835-719f2a914c5e","Type":"ContainerStarted","Data":"d0e3ab26485e8b7af86a25d7de303f85295d43eb142d5eae99ab1998e4b49015"} Jul 09 14:36:53.995662 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.995492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" event={"ID":"0e39a9c5-e364-45cf-a835-719f2a914c5e","Type":"ContainerStarted","Data":"d61ceda65e8cd766f4388b080453b11092780bd85413cdf3b062394c465bb227"} Jul 09 14:36:53.995662 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:53.995585 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:36:54.015296 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:54.015245 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" podStartSLOduration=1.015227886 podStartE2EDuration="1.015227886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:36:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:36:54.013646095 +0000 UTC m=+2447.958253857" watchObservedRunningTime="2026-07-09 14:36:54.015227886 +0000 UTC m=+2447.959835630" Jul 09 14:36:54.075874 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:54.075842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/2.log" Jul 09 14:36:54.083598 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:54.083566 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4nqmg_34506a96-b741-46b1-b3ad-f15dbc4806e2/console-operator/3.log" Jul 09 14:36:54.566684 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:54.566647 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54c54d5864-qzcdd_de779228-6151-4df0-b0e6-425fef8cb034/console/0.log" Jul 09 14:36:54.606172 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:54.606136 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-k75n5_3ce4f7d8-e0bf-49a7-ba94-a098fbe5b1c2/download-server/0.log" Jul 09 14:36:56.345814 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:56.345785 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ktr6t_9295001a-27e2-4430-b2e7-b3a1d900a1d1/dns/0.log" Jul 09 14:36:56.370689 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:56.370658 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ktr6t_9295001a-27e2-4430-b2e7-b3a1d900a1d1/kube-rbac-proxy/0.log" Jul 09 14:36:56.403385 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:56.403349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gslzq_c999078b-b4f6-45f5-b976-a893c69e9e5b/dns-node-resolver/0.log" Jul 09 14:36:57.019039 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:57.019008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6fc886cdd-cd9kx_4436919c-0415-413d-b847-46d4eb53902c/registry/0.log" Jul 09 14:36:57.102160 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:57.102110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqhnt_ecc12acb-0b9d-4a3e-89b5-a8a34f55a9ba/node-ca/0.log" Jul 09 14:36:58.238572 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:58.238538 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zv7fd_c2001523-c366-427d-b82a-cadcffc6787a/discovery/0.log" Jul 09 14:36:58.261567 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:58.261535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f974f5cb9-22twv_8cf815ed-0d80-4dc2-b027-6d906f1376bf/kube-auth-proxy/0.log" Jul 09 14:36:59.231747 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:59.231712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rffpl_99566bc4-d1c4-4c5c-8b6b-67fb5989faad/serve-healthcheck-canary/0.log" Jul 09 14:36:59.722325 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:59.722285 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wkswv_b2805060-7d9d-4076-bed7-99c5ed5f1325/insights-operator/0.log" Jul 09 14:36:59.722828 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:59.722617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wkswv_b2805060-7d9d-4076-bed7-99c5ed5f1325/insights-operator/1.log" Jul 09 14:36:59.828681 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:59.828649 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpg9m_08fa4059-32a1-47e2-be45-46faa1945b8d/kube-rbac-proxy/0.log" Jul 09 14:36:59.855463 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:59.855407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpg9m_08fa4059-32a1-47e2-be45-46faa1945b8d/exporter/0.log" Jul 09 14:36:59.880804 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:36:59.880770 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpg9m_08fa4059-32a1-47e2-be45-46faa1945b8d/extractor/0.log" Jul 09 14:37:00.011392 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:00.011361 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fq7xw/perf-node-gather-daemonset-664jd" Jul 09 14:37:02.068186 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:02.068152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-47rnb_847d128f-9bc6-4727-a5be-298e31d5cb76/manager/0.log" Jul 09 14:37:02.287009 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:02.286957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k7bs9_761db452-a7a0-4685-b656-e48eb8112826/server/0.log" Jul 09 14:37:02.387317 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:02.387217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ptzrp_0833b610-37d9-43b8-8498-abdb43a044a0/manager/0.log" Jul 09 14:37:02.416223 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:02.416181 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74b946fd-nzmvd_64301805-e75c-4184-b03d-1e3a202b4caf/manager/0.log" Jul 09 14:37:02.440877 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:02.440845 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74b946fd-nzmvd_64301805-e75c-4184-b03d-1e3a202b4caf/copy-manifests/0.log" Jul 09 14:37:03.944061 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:03.943974 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zv7fd_c2001523-c366-427d-b82a-cadcffc6787a/discovery/0.log" Jul 09 14:37:03.958056 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:03.958030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f974f5cb9-22twv_8cf815ed-0d80-4dc2-b027-6d906f1376bf/kube-auth-proxy/0.log" Jul 09 14:37:05.505608 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:05.505520 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zv7fd_c2001523-c366-427d-b82a-cadcffc6787a/discovery/0.log" Jul 09 14:37:05.518675 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:05.518639 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f974f5cb9-22twv_8cf815ed-0d80-4dc2-b027-6d906f1376bf/kube-auth-proxy/0.log" Jul 09 14:37:09.345058 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:09.345026 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lvqzh_99c4fba7-80c2-4adb-8ede-1cc4f4437260/migrator/0.log" Jul 09 14:37:09.370088 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:09.370065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lvqzh_99c4fba7-80c2-4adb-8ede-1cc4f4437260/graceful-termination/0.log" Jul 09 14:37:09.732561 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:09.732469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-6blp4_0eb56b35-896d-47d4-b268-fd3e99165c03/kube-storage-version-migrator-operator/1.log" Jul 09 14:37:09.734176 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:09.734152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-6blp4_0eb56b35-896d-47d4-b268-fd3e99165c03/kube-storage-version-migrator-operator/0.log" Jul 09 14:37:10.852481 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.852425 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8w6bd_420baefd-d8f3-4345-8d7e-67a8ee6a9478/kube-multus/0.log" Jul 09 14:37:10.877403 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.877368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/kube-multus-additional-cni-plugins/0.log" Jul 09 14:37:10.900168 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.900140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/egress-router-binary-copy/0.log" Jul 09 14:37:10.924420 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.924388 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/cni-plugins/0.log" Jul 09 14:37:10.953851 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.953819 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/bond-cni-plugin/0.log" Jul 09 14:37:10.976784 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.976757 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/routeoverride-cni/0.log" Jul 09 14:37:10.998942 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:10.998914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/whereabouts-cni-bincopy/0.log" Jul 09 14:37:11.021871 ip-10-0-136-155 kubenswrapper[2559]: I0709 14:37:11.021842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-85gcq_c9251f67-ef1b-4da7-a2fa-43b7531247b2/whereabouts-cni/0.log"