Jul 13 19:38:09.910556 ip-10-0-138-30 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 19:38:09.910569 ip-10-0-138-30 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 19:38:09.910578 ip-10-0-138-30 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 19:38:09.910891 ip-10-0-138-30 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 19:38:19.495909 ip-10-0-138-30 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 13 19:38:19.495926 ip-10-0-138-30 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 30be3d542c2c4dbea724f62e9264a93b -- Jul 13 19:40:10.769564 ip-10-0-138-30 systemd[1]: Starting Kubernetes Kubelet... Jul 13 19:40:11.148594 ip-10-0-138-30 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 19:40:11.148594 ip-10-0-138-30 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 19:40:11.148594 ip-10-0-138-30 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 19:40:11.148594 ip-10-0-138-30 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 19:40:11.148594 ip-10-0-138-30 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 19:40:11.149329 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.148649 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 19:40:11.154627 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154600 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:40:11.154627 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154625 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:40:11.154627 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154633 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154638 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154643 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154648 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154653 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154657 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154661 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154666 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154669 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154673 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154677 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154681 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154685 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154689 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154693 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154697 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154701 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154710 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154714 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154718 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:40:11.154784 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154722 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154727 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154732 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154737 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154739 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154742 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154745 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154747 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154750 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154753 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154756 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154759 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154761 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154764 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154767 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154770 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154773 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154775 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154778 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154780 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:40:11.155239 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154783 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154785 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154788 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154791 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154794 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154796 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154799 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154803 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154807 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154810 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154812 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154815 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154817 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154819 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154822 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154824 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154827 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154829 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154832 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:40:11.155734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154834 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154839 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154843 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154846 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154849 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154852 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154856 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154859 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154863 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154866 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154869 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154872 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154875 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154879 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154883 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154886 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154889 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154892 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154895 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:40:11.156172 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154898 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154900 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154903 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154906 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154909 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154911 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154914 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154917 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154920 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154922 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154925 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154928 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154930 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154934 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154938 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154941 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154944 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154947 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.154950 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155694 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:40:11.156669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155702 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155705 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155708 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155711 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155713 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155717 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155721 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155725 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155727 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155730 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155732 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155734 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155738 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155742 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155746 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155749 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155753 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155756 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155759 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:40:11.157182 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155761 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155765 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155767 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155770 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155773 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155775 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155778 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155780 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155782 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155786 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155788 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155791 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155793 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155796 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155798 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155801 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155804 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155807 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155809 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155811 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:40:11.157678 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155814 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155817 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155819 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155821 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155824 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155826 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155829 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155831 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155833 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155836 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155838 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155841 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155843 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155845 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155848 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155852 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155855 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155858 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155861 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:40:11.158168 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155863 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155866 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155869 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155872 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155874 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155877 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155880 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155882 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155885 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155887 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155890 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155893 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155895 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155898 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155900 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155902 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155905 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155907 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155909 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155912 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:40:11.158635 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155914 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155916 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155919 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155921 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155924 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155927 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155929 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155931 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155934 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155936 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155938 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155941 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155944 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155947 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155949 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155952 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155954 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155957 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155960 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.155963 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:40:11.159106 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156383 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156389 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156392 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156394 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156398 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156400 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156403 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156405 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156408 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156410 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156412 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156415 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156418 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156420 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156423 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156425 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156430 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156433 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156436 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:40:11.159601 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156439 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156442 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156444 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156447 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156449 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156452 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156454 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156457 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156460 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156463 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156466 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156471 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156474 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156476 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156478 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156481 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156483 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156485 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156488 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156490 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:40:11.160049 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156492 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156495 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156497 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156500 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156502 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156504 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156507 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156509 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156512 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156515 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156518 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156520 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156523 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156525 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156528 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156530 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156532 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156536 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156538 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156540 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:40:11.160519 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156544 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156546 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156549 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156552 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156555 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156557 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156560 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156562 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156565 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156567 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156571 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156574 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156576 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156580 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156583 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156585 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156588 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156590 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156592 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156594 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:40:11.160985 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156597 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156599 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156601 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156606 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156609 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156612 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156614 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156616 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156619 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156621 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156624 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156626 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156629 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156631 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156634 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156638 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156642 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156645 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156648 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.156650 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156723 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 19:40:11.161533 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156733 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156743 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156750 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156757 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156761 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156770 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156774 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156777 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156780 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156783 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156787 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156790 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156793 2576 flags.go:64] FLAG: --cgroup-root="" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156795 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156798 2576 flags.go:64] FLAG: --client-ca-file="" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156802 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156805 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156809 2576 flags.go:64] FLAG: --cluster-domain="" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156812 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156815 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156818 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156822 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156826 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 19:40:11.162072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156828 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156831 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156834 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156838 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156841 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156844 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156847 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156850 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156853 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156856 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156859 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156862 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156864 2576 flags.go:64] FLAG: --enable-server="true" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156867 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156871 2576 flags.go:64] FLAG: --event-burst="100" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156874 2576 flags.go:64] FLAG: --event-qps="50" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156877 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156880 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156882 2576 flags.go:64] FLAG: --eviction-hard="" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156886 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156889 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156891 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156894 2576 flags.go:64] FLAG: --eviction-soft="" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156897 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156899 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 19:40:11.162634 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156902 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156905 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156908 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156911 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156914 2576 flags.go:64] FLAG: --feature-gates="" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156917 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156920 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156923 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156925 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156928 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156931 2576 flags.go:64] FLAG: --help="false" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156934 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156937 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156939 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156943 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156946 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156949 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156952 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156954 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156957 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156960 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156962 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156965 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156968 2576 flags.go:64] FLAG: --kube-reserved="" Jul 13 19:40:11.163212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156979 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156982 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156985 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156988 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156990 2576 flags.go:64] FLAG: --lock-file="" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156993 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156995 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.156998 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157023 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157026 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157029 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157032 2576 flags.go:64] FLAG: --logging-format="text" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157035 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157038 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157041 2576 flags.go:64] FLAG: --manifest-url="" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157044 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157048 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157051 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157055 2576 flags.go:64] FLAG: --max-pods="110" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157058 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157061 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157063 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157066 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157069 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157072 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 19:40:11.163797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157075 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157082 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157085 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157088 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157091 2576 flags.go:64] FLAG: --pod-cidr="" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157094 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157100 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157103 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157106 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157109 2576 flags.go:64] FLAG: --port="10250" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157112 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157115 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a18951e7993cc7e7" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157118 2576 flags.go:64] FLAG: --qos-reserved="" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157121 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157124 2576 flags.go:64] FLAG: --register-node="true" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157127 2576 flags.go:64] FLAG: --register-with-taints="" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157132 2576 flags.go:64] FLAG: --registry-burst="10" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157136 2576 flags.go:64] FLAG: --registry-qps="5" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157139 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157141 2576 flags.go:64] FLAG: --reserved-memory="" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157145 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157148 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157151 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157154 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157156 2576 flags.go:64] FLAG: --runonce="false" Jul 13 19:40:11.164483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157159 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157163 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157166 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157168 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157171 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157174 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157177 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157180 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157183 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157186 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157189 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157192 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157195 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157198 2576 flags.go:64] FLAG: --system-cgroups="" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157200 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157206 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157209 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157212 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157216 2576 flags.go:64] FLAG: --tls-min-version="" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157219 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157222 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157224 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157227 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157232 2576 flags.go:64] FLAG: --v="2" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157236 2576 flags.go:64] FLAG: --version="false" Jul 13 19:40:11.165135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157240 2576 flags.go:64] FLAG: --vmodule="" Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157257 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.157261 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157388 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157392 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157395 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157399 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157403 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157406 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157409 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157411 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157414 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157417 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157420 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157423 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157426 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157429 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157432 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157434 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157437 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:40:11.165767 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157440 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157442 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157445 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157447 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157450 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157452 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157455 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157457 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157460 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157462 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157467 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157469 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157472 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157475 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157477 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157480 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157483 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157485 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157488 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157492 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:40:11.166283 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157494 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157497 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157500 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157503 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157505 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157508 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157510 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157513 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157515 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157518 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157520 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157525 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157529 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157531 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157534 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157537 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157540 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157542 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157545 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:40:11.166753 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157547 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157551 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157555 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157558 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157561 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157564 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157568 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157572 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157575 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157577 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157580 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157583 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157586 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157589 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157591 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157594 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157596 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157599 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157602 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:40:11.167211 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157604 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157607 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157609 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157611 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157614 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157617 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157619 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157622 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157624 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157627 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157629 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157632 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157634 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157636 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157639 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157641 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157645 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157648 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157651 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157653 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:40:11.167723 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157655 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157659 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157662 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.157664 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.158362 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.166048 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.166066 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.166884 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.166893 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166956 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166962 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166965 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166968 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166971 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166973 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:40:11.168192 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166976 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166979 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166981 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166984 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166987 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166991 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166995 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.166997 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167000 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167003 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167006 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167009 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167012 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167014 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167017 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167019 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167022 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167024 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167028 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:40:11.168576 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167031 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167033 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167036 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167039 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167042 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167045 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167047 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167050 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167053 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167055 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167058 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167060 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167062 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167065 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167068 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167070 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167073 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167075 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167078 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167081 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:40:11.169054 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167083 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167085 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167088 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167091 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167093 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167096 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167098 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167102 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167106 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167109 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167111 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167114 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167117 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167120 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167123 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167125 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167128 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167130 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167133 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167135 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:40:11.169553 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167137 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167140 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167142 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167145 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167147 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167149 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167152 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167154 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167157 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167159 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167162 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167164 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167167 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167171 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167174 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167176 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167179 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167181 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167183 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:40:11.170039 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167186 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167189 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167192 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167194 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167197 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167202 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167205 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167207 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167210 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167212 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167215 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167218 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167220 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167222 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:40:11.170529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.167228 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167390 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167396 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167398 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167401 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167404 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167407 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167409 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167411 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167414 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167416 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167419 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167422 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167425 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167427 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167430 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167432 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167435 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167437 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167440 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:40:11.170891 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167442 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167445 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167447 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167450 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167457 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167459 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167463 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167467 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167470 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167473 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167475 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167477 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167480 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167482 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167485 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167487 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167489 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167492 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167494 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167496 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:40:11.171374 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167499 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167501 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167503 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167506 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167508 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167511 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167513 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167515 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167518 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167520 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167523 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167526 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167528 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167530 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167533 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167535 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167537 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167540 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167543 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167546 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:40:11.171840 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167548 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167551 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167553 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167555 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167558 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167560 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167562 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167564 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167567 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167569 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167572 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167574 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167576 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167579 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167581 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167583 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167586 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167588 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167592 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:40:11.172328 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167595 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167598 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167601 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167604 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167607 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167610 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167612 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167615 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167617 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167620 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167623 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167626 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167629 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167631 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167633 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167636 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167638 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167641 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167643 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:40:11.172774 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167645 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:11.167649 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.167654 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.167775 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.170091 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.171615 2576 server.go:1019] "Starting client certificate rotation" Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.171725 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 19:40:11.173276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.172711 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 19:40:11.174219 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.174205 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 19:40:11.175980 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.175958 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 19:40:11.186660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.186638 2576 log.go:25] "Validated CRI v1 runtime API" Jul 13 19:40:11.188908 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.188892 2576 log.go:25] "Validated CRI v1 image API" Jul 13 19:40:11.192191 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.192169 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 19:40:11.195020 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.195003 2576 fs.go:135] Filesystem UUIDs: map[01c26cf3-7bba-4d7d-94d9-7060538f7365:/dev/nvme0n1p3 0c9ccfa9-3879-4f9f-9350-8a072e901a55:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 13 19:40:11.195082 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.195021 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 19:40:11.200713 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.200600 2576 manager.go:216] Machine: {Timestamp:2026-07-13 19:40:11.199380169 +0000 UTC m=+0.311575210 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110256 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289261eb1680ab291926f5d0eb03c9 SystemUUID:ec289261-eb16-80ab-2919-26f5d0eb03c9 BootID:30be3d54-2c2c-4dbe-a724-f62e9264a93b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:4b:61:f9:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:4b:61:f9:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:b0:05:33:46:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 19:40:11.200713 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.200705 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 19:40:11.200831 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.200784 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 19:40:11.201486 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.201468 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 19:40:11.203431 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.203408 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 19:40:11.203565 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.203435 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 19:40:11.204195 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.204185 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 19:40:11.204226 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.204199 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 19:40:11.204226 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.204207 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 19:40:11.204824 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.204815 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 19:40:11.206438 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.206429 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 19:40:11.209660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209648 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 13 19:40:11.209780 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209771 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 19:40:11.209814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209811 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 13 19:40:11.209843 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209824 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 19:40:11.209843 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209838 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 19:40:11.209906 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209846 2576 kubelet.go:398] "Adding apiserver pod source" Jul 13 19:40:11.209906 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.209860 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 19:40:11.210371 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.210356 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 19:40:11.210455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.210388 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 19:40:11.212587 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.212570 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 19:40:11.214790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.214777 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 19:40:11.214845 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.214807 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 19:40:11.214970 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.214959 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 19:40:11.215002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.214980 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 19:40:11.215002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.214991 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 19:40:11.215002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.214999 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 19:40:11.215076 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215008 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 19:40:11.215076 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215013 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 19:40:11.215545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215536 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 19:40:11.215545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215546 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 19:40:11.215646 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215553 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 19:40:11.215646 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215558 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 19:40:11.215646 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215567 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 19:40:11.215646 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.215574 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 19:40:11.216789 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.216779 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 19:40:11.216789 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.216789 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 19:40:11.219753 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.219735 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 19:40:11.219753 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.219731 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 19:40:11.219860 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.219730 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 19:40:11.220326 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.220314 2576 server.go:1268] "Started kubelet" Jul 13 19:40:11.220412 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.220391 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 19:40:11.220533 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.220473 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 19:40:11.220759 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.220549 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 19:40:11.224857 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.224793 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 19:40:11.224909 ip-10-0-138-30 systemd[1]: Started Kubernetes Kubelet. Jul 13 19:40:11.227401 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.227167 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 13 19:40:11.227523 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.227472 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 19:40:11.230780 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.229882 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-30.ec2.internal.18c1f0ba802a990b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-30.ec2.internal,UID:ip-10-0-138-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-30.ec2.internal,},FirstTimestamp:2026-07-13 19:40:11.220285707 +0000 UTC m=+0.332480747,LastTimestamp:2026-07-13 19:40:11.220285707 +0000 UTC m=+0.332480747,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-30.ec2.internal,}" Jul 13 19:40:11.233820 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.233803 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 19:40:11.233914 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.233862 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 19:40:11.233967 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.233915 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.234553 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234535 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 19:40:11.234640 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234580 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 19:40:11.234640 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234592 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 19:40:11.234740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234663 2576 factory.go:55] Registering systemd factory Jul 13 19:40:11.234740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234704 2576 factory.go:223] Registration of the systemd container factory successfully Jul 13 19:40:11.234740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234667 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 13 19:40:11.234740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234741 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 13 19:40:11.234911 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234896 2576 factory.go:153] Registering CRI-O factory Jul 13 19:40:11.234949 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234917 2576 factory.go:223] Registration of the crio container factory successfully Jul 13 19:40:11.234981 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234971 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 19:40:11.235018 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.234997 2576 factory.go:103] Registering Raw factory Jul 13 19:40:11.235018 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.235015 2576 manager.go:1196] Started watching for new ooms in manager Jul 13 19:40:11.235534 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.235476 2576 manager.go:349] Starting recovery of all containers Jul 13 19:40:11.239522 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.239493 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 19:40:11.239639 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.239616 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 19:40:11.243317 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.243099 2576 manager.go:354] Recovery completed Jul 13 19:40:11.248097 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.248085 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.252751 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.252730 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.252850 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.252821 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.252850 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.252840 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.253437 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.253421 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 19:40:11.253437 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.253436 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 19:40:11.253558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.253445 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.253558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.253455 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 13 19:40:11.254184 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.254168 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.254282 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.254196 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.254282 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.254205 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.254748 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.254734 2576 policy_none.go:49] "None policy: Start" Jul 13 19:40:11.254819 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.254756 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 19:40:11.254819 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.254767 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 19:40:11.254893 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.254766 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-30.ec2.internal.18c1f0ba8219fe2f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-30.ec2.internal,UID:ip-10-0-138-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-30.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-30.ec2.internal,},FirstTimestamp:2026-07-13 19:40:11.252751919 +0000 UTC m=+0.364946970,LastTimestamp:2026-07-13 19:40:11.252751919 +0000 UTC m=+0.364946970,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-30.ec2.internal,}" Jul 13 19:40:11.255776 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.255761 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-852tv" Jul 13 19:40:11.255861 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.255801 2576 policy_none.go:47] "Start" Jul 13 19:40:11.263513 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.263487 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-852tv" Jul 13 19:40:11.264389 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.264318 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-30.ec2.internal.18c1f0ba821b306f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-30.ec2.internal,UID:ip-10-0-138-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-30.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-30.ec2.internal,},FirstTimestamp:2026-07-13 19:40:11.252830319 +0000 UTC m=+0.365025362,LastTimestamp:2026-07-13 19:40:11.252830319 +0000 UTC m=+0.365025362,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-30.ec2.internal,}" Jul 13 19:40:11.302871 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.302845 2576 manager.go:337] "Starting Device Plugin manager" Jul 13 19:40:11.302985 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.302891 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 19:40:11.302985 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.302903 2576 server.go:87] "Starting device plugin registration server" Jul 13 19:40:11.303210 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.303195 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 19:40:11.303264 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.303213 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 19:40:11.303324 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.303309 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 19:40:11.303412 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.303400 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 19:40:11.303465 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.303416 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 19:40:11.303990 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.303971 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 19:40:11.304079 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.304024 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.371771 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.371731 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 19:40:11.373955 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.373089 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 19:40:11.373955 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.373133 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 19:40:11.373955 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.373160 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 19:40:11.373955 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.373202 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 19:40:11.375729 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.375713 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:40:11.404063 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.403998 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.405137 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.405121 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.405186 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.405153 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.405186 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.405171 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.405265 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.405197 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.414467 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.414448 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.414533 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.414473 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-30.ec2.internal\": node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.440810 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.440785 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.474368 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.473603 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal"] Jul 13 19:40:11.474493 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.474409 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.475349 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.475324 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.475349 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.475353 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.475509 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.475362 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.477720 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.477706 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.477842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.477827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.477905 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.477863 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.478432 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.478414 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.478530 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.478443 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.478530 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.478456 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.478530 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.478506 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.478530 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.478527 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.478702 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.478536 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.480682 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.480666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.480764 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.480696 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:11.481515 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.481498 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:11.481620 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.481527 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:11.481620 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.481540 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:11.500845 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.500826 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-30.ec2.internal\" not found" node="ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.505199 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.505183 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-30.ec2.internal\" not found" node="ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.537696 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.537668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d97e35cd5cb8422951c7b954faa30c15-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal\" (UID: \"d97e35cd5cb8422951c7b954faa30c15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.537805 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.537698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d97e35cd5cb8422951c7b954faa30c15-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal\" (UID: \"d97e35cd5cb8422951c7b954faa30c15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.537805 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.537714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e03e2aa8c921c7d74e9b77683073fbc0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-30.ec2.internal\" (UID: \"e03e2aa8c921c7d74e9b77683073fbc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.541775 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.541762 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.638891 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.638859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d97e35cd5cb8422951c7b954faa30c15-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal\" (UID: \"d97e35cd5cb8422951c7b954faa30c15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.639038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.638894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e03e2aa8c921c7d74e9b77683073fbc0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-30.ec2.internal\" (UID: \"e03e2aa8c921c7d74e9b77683073fbc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.639038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.638912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d97e35cd5cb8422951c7b954faa30c15-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal\" (UID: \"d97e35cd5cb8422951c7b954faa30c15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.639038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.638956 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d97e35cd5cb8422951c7b954faa30c15-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal\" (UID: \"d97e35cd5cb8422951c7b954faa30c15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.639038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.638980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e03e2aa8c921c7d74e9b77683073fbc0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-30.ec2.internal\" (UID: \"e03e2aa8c921c7d74e9b77683073fbc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.639038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.638980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d97e35cd5cb8422951c7b954faa30c15-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal\" (UID: \"d97e35cd5cb8422951c7b954faa30c15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.641942 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.641928 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.742885 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.742804 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.803011 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.802989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.809240 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:11.809221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" Jul 13 19:40:11.843854 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.843818 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:11.944410 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:11.944373 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.044946 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.044858 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.073883 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.073855 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:40:12.145553 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.145520 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.171336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.171305 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 19:40:12.171946 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.171490 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 19:40:12.171946 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.171527 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 19:40:12.245920 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.245893 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.267770 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.267724 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 19:35:12 +0000 UTC" deadline="2028-03-10 23:08:01.479180562 +0000 UTC" Jul 13 19:40:12.267770 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.267762 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14547h27m49.211423007s" Jul 13 19:40:12.275826 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.275800 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:40:12.346364 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.346287 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.421470 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:12.421422 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97e35cd5cb8422951c7b954faa30c15.slice/crio-b6da395c7106a4f2614541829bd99638c556a33d08c4e2d32c6c05b69c819d15 WatchSource:0}: Error finding container b6da395c7106a4f2614541829bd99638c556a33d08c4e2d32c6c05b69c819d15: Status 404 returned error can't find the container with id b6da395c7106a4f2614541829bd99638c556a33d08c4e2d32c6c05b69c819d15 Jul 13 19:40:12.422853 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:12.422831 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03e2aa8c921c7d74e9b77683073fbc0.slice/crio-126f6e62223709dca7ed44bd8d4be106f6728a188fb86e482036824f2fb776ba WatchSource:0}: Error finding container 126f6e62223709dca7ed44bd8d4be106f6728a188fb86e482036824f2fb776ba: Status 404 returned error can't find the container with id 126f6e62223709dca7ed44bd8d4be106f6728a188fb86e482036824f2fb776ba Jul 13 19:40:12.426115 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.426100 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 19:40:12.437086 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.437067 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:40:12.438157 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.438137 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:40:12.438280 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.438184 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:40:12.438280 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.438203 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:40:12.446357 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.446335 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.546597 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.546548 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.647624 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.647533 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.747743 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:12.747711 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-30.ec2.internal\" not found" Jul 13 19:40:12.808282 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.808249 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:40:12.835292 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.835241 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" Jul 13 19:40:12.848968 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.848945 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 19:40:12.850082 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.850064 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" Jul 13 19:40:12.856536 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:12.856516 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 19:40:13.212952 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.212908 2576 apiserver.go:52] "Watching apiserver" Jul 13 19:40:13.222789 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.222760 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 19:40:13.224673 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.224650 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dklm7","openshift-network-diagnostics/network-check-target-wkc5n","openshift-network-operator/iptables-alerter-pxq2p","openshift-ovn-kubernetes/ovnkube-node-s6frd","kube-system/global-pull-secret-syncer-pqb4t","kube-system/konnectivity-agent-4qkzc","kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l8szp","openshift-dns/node-resolver-nglhf","openshift-multus/multus-fccvh","openshift-multus/network-metrics-daemon-r8j9t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd","openshift-image-registry/node-ca-k6bh9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal"] Jul 13 19:40:13.228642 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.228625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.230857 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.230834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.233159 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.233140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.233638 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.233616 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.233752 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.233648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tcjnd\"" Jul 13 19:40:13.233752 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.233623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.233752 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.233627 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.233752 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.233629 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.234129 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.234099 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-25gw7\"" Jul 13 19:40:13.234129 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.234114 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 19:40:13.234243 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.234114 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 19:40:13.234347 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.234331 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 19:40:13.234720 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.234704 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 19:40:13.235674 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.235658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.236696 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.236677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.236790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.236680 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qhh2\"" Jul 13 19:40:13.237103 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.237083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 19:40:13.237186 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.237150 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.238094 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.238070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.238180 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.238152 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:13.239860 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.239843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.239860 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.239843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 19:40:13.240040 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.239885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ks5xb\"" Jul 13 19:40:13.240040 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.239939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 19:40:13.240201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.240095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 19:40:13.240201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.240191 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.240345 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.240197 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 19:40:13.240437 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.240423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.242835 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.242819 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fmsq7\"" Jul 13 19:40:13.242944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.242852 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 19:40:13.242944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.242887 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 19:40:13.243052 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.242945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.245413 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.245397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.245938 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.245915 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.246037 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.245960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jtptv\"" Jul 13 19:40:13.246298 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.246285 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.247149 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-ovn\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-log-socket\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-cni-netd\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247286 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovn-node-metrics-cert\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247286 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwgbl\" (UniqueName: \"kubernetes.io/projected/f7250f25-6011-48c2-a234-e8c7f1a94cbc-kube-api-access-gwgbl\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-cni-multus\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-cni-bin\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247496 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247496 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-cni-bin\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247605 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-kubelet\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247605 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-hostroot\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247605 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-multus-certs\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs6qt\" (UniqueName: \"kubernetes.io/projected/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-kube-api-access-zs6qt\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-host\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.247760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-slash\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.247760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-socket-dir-parent\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.247760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgsh\" (UniqueName: \"kubernetes.io/projected/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-kube-api-access-6cgsh\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c23a939-29a4-4f33-a40a-8582b2265e9d-iptables-alerter-script\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-kubelet\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-os-release\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-serviceca\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c23a939-29a4-4f33-a40a-8582b2265e9d-host-slash\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82xs\" (UniqueName: \"kubernetes.io/projected/9c23a939-29a4-4f33-a40a-8582b2265e9d-kube-api-access-m82xs\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.247990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovnkube-script-lib\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-netns\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-daemon-config\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-systemd-units\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-system-cni-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-cni-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-cnibin\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-run-netns\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.248249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-node-log\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovnkube-config\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-env-overrides\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-cni-binary-copy\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-k8s-cni-cncf-io\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-systemd\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-etc-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-conf-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-etc-kubernetes\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-var-lib-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248800 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7f5z5\"" Jul 13 19:40:13.248879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248821 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.249181 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.248936 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.251232 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.251211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.252064 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.252030 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 19:40:13.254961 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.254937 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 19:40:13.255172 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.255137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 19:40:13.255254 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.255203 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-88r4t\"" Jul 13 19:40:13.255774 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.255754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.255931 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.255907 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:13.259442 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.259424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.262436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.262413 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 19:40:13.262575 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.262556 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 19:40:13.262649 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.262579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9gtd\"" Jul 13 19:40:13.262757 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.262737 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 19:40:13.279982 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.279955 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8xr47" Jul 13 19:40:13.293497 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.293474 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:40:13.294599 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.294577 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8xr47" Jul 13 19:40:13.336174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.336146 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 19:40:13.349313 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8lrm\" (UniqueName: \"kubernetes.io/projected/b907e1ab-a109-4086-880b-17b4f82ec6ff-kube-api-access-q8lrm\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.349455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-netns\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-sys\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.349455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-lib-modules\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.349455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23296317-6bbe-4754-8973-ed96f2cb6370-agent-certs\") pod \"konnectivity-agent-4qkzc\" (UID: \"23296317-6bbe-4754-8973-ed96f2cb6370\") " pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.349455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349413 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-netns\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-hosts-file\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-run\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-run-netns\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovnkube-config\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-cni-binary-copy\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349586 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-run-netns\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.349687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-etc-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-conf-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349774 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-etc-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-etc-kubernetes\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349835 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-conf-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysconfig\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-etc-kubernetes\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.349998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.349997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23296317-6bbe-4754-8973-ed96f2cb6370-konnectivity-ca\") pod \"konnectivity-agent-4qkzc\" (UID: \"23296317-6bbe-4754-8973-ed96f2cb6370\") " pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-var-lib-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350040 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovnkube-config\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-log-socket\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovn-node-metrics-cert\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwgbl\" (UniqueName: \"kubernetes.io/projected/f7250f25-6011-48c2-a234-e8c7f1a94cbc-kube-api-access-gwgbl\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-log-socket\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-cni-binary-copy\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-multus-certs\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-var-lib-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350234 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-multus-certs\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-cni-bin\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350301 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-kubelet\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-hostroot\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350332 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-cni-bin\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.350397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c23a939-29a4-4f33-a40a-8582b2265e9d-iptables-alerter-script\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350374 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-kubelet\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-tmp-dir\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-hostroot\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8rd\" (UniqueName: \"kubernetes.io/projected/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-kube-api-access-2l8rd\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-slash\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350534 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-kubernetes\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-slash\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysctl-d\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350603 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-openvswitch\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysctl-conf\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-host\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-system-cni-dir\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.351114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-serviceca\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c23a939-29a4-4f33-a40a-8582b2265e9d-host-slash\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-sys-fs\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05c816ec-c5a3-490c-84b5-a0acc65f56c4-kubelet-config\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350803 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c23a939-29a4-4f33-a40a-8582b2265e9d-host-slash\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovnkube-script-lib\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-daemon-config\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.350894 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c23a939-29a4-4f33-a40a-8582b2265e9d-iptables-alerter-script\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wh26\" (UniqueName: \"kubernetes.io/projected/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-kube-api-access-6wh26\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-var-lib-kubelet\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7788da02-52db-4b8a-bf0b-39beec89de4e-tmp\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351097 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-serviceca\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-registration-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-systemd-units\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-systemd-units\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-system-cni-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.351841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-cni-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351428 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-system-cni-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351488 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-daemon-config\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovnkube-script-lib\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-cni-dir\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-cnibin\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351725 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-cnibin\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05c816ec-c5a3-490c-84b5-a0acc65f56c4-dbus\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-node-log\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-env-overrides\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-k8s-cni-cncf-io\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-device-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-node-log\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-run-k8s-cni-cncf-io\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.351999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-systemd\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-ovn\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-cni-netd\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352062 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-systemd\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.352667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-cni-multus\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-run-ovn\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-host\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-cni-netd\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82xs\" (UniqueName: \"kubernetes.io/projected/9c23a939-29a4-4f33-a40a-8582b2265e9d-kube-api-access-m82xs\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-host\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-cni-bin\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7250f25-6011-48c2-a234-e8c7f1a94cbc-env-overrides\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs6qt\" (UniqueName: \"kubernetes.io/projected/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-kube-api-access-zs6qt\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgsh\" (UniqueName: \"kubernetes.io/projected/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-kube-api-access-6cgsh\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-cni-bin\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-modprobe-d\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352143 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-host-var-lib-cni-multus\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-os-release\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-socket-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.353238 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-socket-dir-parent\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-systemd\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-tuned\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5wtn\" (UniqueName: \"kubernetes.io/projected/7788da02-52db-4b8a-bf0b-39beec89de4e-kube-api-access-r5wtn\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-cnibin\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-multus-socket-dir-parent\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkll9\" (UniqueName: \"kubernetes.io/projected/26766f69-fba3-459e-b86b-fc66ba03d5b1-kube-api-access-mkll9\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-kubelet\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352699 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-kubelet\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-os-release\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-os-release\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.353842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.352760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7250f25-6011-48c2-a234-e8c7f1a94cbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.354362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.354176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7250f25-6011-48c2-a234-e8c7f1a94cbc-ovn-node-metrics-cert\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.368536 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.368492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwgbl\" (UniqueName: \"kubernetes.io/projected/f7250f25-6011-48c2-a234-e8c7f1a94cbc-kube-api-access-gwgbl\") pod \"ovnkube-node-s6frd\" (UID: \"f7250f25-6011-48c2-a234-e8c7f1a94cbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.368536 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.368514 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgsh\" (UniqueName: \"kubernetes.io/projected/95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba-kube-api-access-6cgsh\") pod \"node-ca-k6bh9\" (UID: \"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba\") " pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.368997 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.368979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs6qt\" (UniqueName: \"kubernetes.io/projected/9420c69c-39ac-44f2-9b79-2ff1953b1fe5-kube-api-access-zs6qt\") pod \"multus-fccvh\" (UID: \"9420c69c-39ac-44f2-9b79-2ff1953b1fe5\") " pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.369227 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.369209 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82xs\" (UniqueName: \"kubernetes.io/projected/9c23a939-29a4-4f33-a40a-8582b2265e9d-kube-api-access-m82xs\") pod \"iptables-alerter-pxq2p\" (UID: \"9c23a939-29a4-4f33-a40a-8582b2265e9d\") " pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.378249 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.378162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" event={"ID":"d97e35cd5cb8422951c7b954faa30c15","Type":"ContainerStarted","Data":"b6da395c7106a4f2614541829bd99638c556a33d08c4e2d32c6c05b69c819d15"} Jul 13 19:40:13.381344 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.381313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" event={"ID":"e03e2aa8c921c7d74e9b77683073fbc0","Type":"ContainerStarted","Data":"126f6e62223709dca7ed44bd8d4be106f6728a188fb86e482036824f2fb776ba"} Jul 13 19:40:13.453388 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-sys\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453388 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-lib-modules\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23296317-6bbe-4754-8973-ed96f2cb6370-agent-certs\") pod \"konnectivity-agent-4qkzc\" (UID: \"23296317-6bbe-4754-8973-ed96f2cb6370\") " pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-hosts-file\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-run\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453491 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-sys\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453553 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-run\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453588 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-lib-modules\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-hosts-file\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysconfig\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.453652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysconfig\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23296317-6bbe-4754-8973-ed96f2cb6370-konnectivity-ca\") pod \"konnectivity-agent-4qkzc\" (UID: \"23296317-6bbe-4754-8973-ed96f2cb6370\") " pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-tmp-dir\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8rd\" (UniqueName: \"kubernetes.io/projected/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-kube-api-access-2l8rd\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.453864 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-kubernetes\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.453955 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:40:13.953929458 +0000 UTC m=+3.066124504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453969 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-kubernetes\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.453988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysctl-d\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysctl-conf\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-host\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454025 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-tmp-dir\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.454146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-host\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454159 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-system-cni-dir\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-system-cni-dir\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysctl-d\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-sys-fs\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05c816ec-c5a3-490c-84b5-a0acc65f56c4-kubelet-config\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454260 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wh26\" (UniqueName: \"kubernetes.io/projected/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-kube-api-access-6wh26\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05c816ec-c5a3-490c-84b5-a0acc65f56c4-kubelet-config\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-var-lib-kubelet\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7788da02-52db-4b8a-bf0b-39beec89de4e-tmp\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-sys-fs\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-registration-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05c816ec-c5a3-490c-84b5-a0acc65f56c4-dbus\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-var-lib-kubelet\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23296317-6bbe-4754-8973-ed96f2cb6370-konnectivity-ca\") pod \"konnectivity-agent-4qkzc\" (UID: \"23296317-6bbe-4754-8973-ed96f2cb6370\") " pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.454999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-device-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-sysctl-conf\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-registration-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454536 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-device-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-modprobe-d\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05c816ec-c5a3-490c-84b5-a0acc65f56c4-dbus\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-os-release\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-modprobe-d\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.454633 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454643 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-os-release\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-socket-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.454684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:13.954666356 +0000 UTC m=+3.066861388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-systemd\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454742 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-socket-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.455660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-tuned\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5wtn\" (UniqueName: \"kubernetes.io/projected/7788da02-52db-4b8a-bf0b-39beec89de4e-kube-api-access-r5wtn\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-systemd\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-cnibin\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454842 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26766f69-fba3-459e-b86b-fc66ba03d5b1-cnibin\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkll9\" (UniqueName: \"kubernetes.io/projected/26766f69-fba3-459e-b86b-fc66ba03d5b1-kube-api-access-mkll9\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.454945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8lrm\" (UniqueName: \"kubernetes.io/projected/b907e1ab-a109-4086-880b-17b4f82ec6ff-kube-api-access-q8lrm\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.455087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.455245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b907e1ab-a109-4086-880b-17b4f82ec6ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.456165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.455468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26766f69-fba3-459e-b86b-fc66ba03d5b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.456741 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.456720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7788da02-52db-4b8a-bf0b-39beec89de4e-tmp\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.456805 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.456774 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23296317-6bbe-4754-8973-ed96f2cb6370-agent-certs\") pod \"konnectivity-agent-4qkzc\" (UID: \"23296317-6bbe-4754-8973-ed96f2cb6370\") " pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.457276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.457239 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7788da02-52db-4b8a-bf0b-39beec89de4e-etc-tuned\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.467500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.467443 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:13.467500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.467463 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:13.467500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.467473 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:13.467671 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.467524 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:40:13.967508361 +0000 UTC m=+3.079703390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:13.473537 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.473503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8lrm\" (UniqueName: \"kubernetes.io/projected/b907e1ab-a109-4086-880b-17b4f82ec6ff-kube-api-access-q8lrm\") pod \"aws-ebs-csi-driver-node-pz2hd\" (UID: \"b907e1ab-a109-4086-880b-17b4f82ec6ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.473664 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.473642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkll9\" (UniqueName: \"kubernetes.io/projected/26766f69-fba3-459e-b86b-fc66ba03d5b1-kube-api-access-mkll9\") pod \"multus-additional-cni-plugins-dklm7\" (UID: \"26766f69-fba3-459e-b86b-fc66ba03d5b1\") " pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.473928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.473910 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wh26\" (UniqueName: \"kubernetes.io/projected/b1f4a4e8-173a-47ab-a4ee-153aa40302bf-kube-api-access-6wh26\") pod \"node-resolver-nglhf\" (UID: \"b1f4a4e8-173a-47ab-a4ee-153aa40302bf\") " pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.474263 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.474232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5wtn\" (UniqueName: \"kubernetes.io/projected/7788da02-52db-4b8a-bf0b-39beec89de4e-kube-api-access-r5wtn\") pod \"tuned-l8szp\" (UID: \"7788da02-52db-4b8a-bf0b-39beec89de4e\") " pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.474316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.474299 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8rd\" (UniqueName: \"kubernetes.io/projected/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-kube-api-access-2l8rd\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.539175 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.539136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fccvh" Jul 13 19:40:13.550162 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.550136 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9420c69c_39ac_44f2_9b79_2ff1953b1fe5.slice/crio-4b09cefc8ec35dc1b224cbddc2f19f755e4d32e6a58b9fcb025423ee62f3e709 WatchSource:0}: Error finding container 4b09cefc8ec35dc1b224cbddc2f19f755e4d32e6a58b9fcb025423ee62f3e709: Status 404 returned error can't find the container with id 4b09cefc8ec35dc1b224cbddc2f19f755e4d32e6a58b9fcb025423ee62f3e709 Jul 13 19:40:13.551597 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.551575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k6bh9" Jul 13 19:40:13.560527 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.560498 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c8cbcb_e64a_4ebc_80a8_3ef9fb70a8ba.slice/crio-ad6dfeb47a7adcb4799f1c9ca5e12e19cfb91eb74a3a716e0103a22ee199e8d4 WatchSource:0}: Error finding container ad6dfeb47a7adcb4799f1c9ca5e12e19cfb91eb74a3a716e0103a22ee199e8d4: Status 404 returned error can't find the container with id ad6dfeb47a7adcb4799f1c9ca5e12e19cfb91eb74a3a716e0103a22ee199e8d4 Jul 13 19:40:13.565072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.563694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pxq2p" Jul 13 19:40:13.567409 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.567389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:13.574322 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.574296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:13.576291 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.576266 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c23a939_29a4_4f33_a40a_8582b2265e9d.slice/crio-75d2930320276c4180fee3c8dc5e4e84c7339cad9a1e8af8f393dd04e37fca41 WatchSource:0}: Error finding container 75d2930320276c4180fee3c8dc5e4e84c7339cad9a1e8af8f393dd04e37fca41: Status 404 returned error can't find the container with id 75d2930320276c4180fee3c8dc5e4e84c7339cad9a1e8af8f393dd04e37fca41 Jul 13 19:40:13.579649 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.579626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nglhf" Jul 13 19:40:13.580013 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.579986 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7250f25_6011_48c2_a234_e8c7f1a94cbc.slice/crio-9ff9000d17933b01cf7f75de90175d4f97059d9221e3ad1eed4c376b4b0c3bba WatchSource:0}: Error finding container 9ff9000d17933b01cf7f75de90175d4f97059d9221e3ad1eed4c376b4b0c3bba: Status 404 returned error can't find the container with id 9ff9000d17933b01cf7f75de90175d4f97059d9221e3ad1eed4c376b4b0c3bba Jul 13 19:40:13.586858 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.586840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l8szp" Jul 13 19:40:13.587573 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.587547 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23296317_6bbe_4754_8973_ed96f2cb6370.slice/crio-6c6670222af2168b868e33d88bbcf03724e196fbaa65db5e90715f488060e530 WatchSource:0}: Error finding container 6c6670222af2168b868e33d88bbcf03724e196fbaa65db5e90715f488060e530: Status 404 returned error can't find the container with id 6c6670222af2168b868e33d88bbcf03724e196fbaa65db5e90715f488060e530 Jul 13 19:40:13.590605 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.590580 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f4a4e8_173a_47ab_a4ee_153aa40302bf.slice/crio-8556d4fa902a555d22c65f2993d506c80c35ac3db559d5005f16c6a9858cb408 WatchSource:0}: Error finding container 8556d4fa902a555d22c65f2993d506c80c35ac3db559d5005f16c6a9858cb408: Status 404 returned error can't find the container with id 8556d4fa902a555d22c65f2993d506c80c35ac3db559d5005f16c6a9858cb408 Jul 13 19:40:13.591286 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.591229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dklm7" Jul 13 19:40:13.596059 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.596032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" Jul 13 19:40:13.597805 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.597783 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7788da02_52db_4b8a_bf0b_39beec89de4e.slice/crio-70e4ab4e07cf463634310a005635ce1e19573a691cc87b8d955733574780514a WatchSource:0}: Error finding container 70e4ab4e07cf463634310a005635ce1e19573a691cc87b8d955733574780514a: Status 404 returned error can't find the container with id 70e4ab4e07cf463634310a005635ce1e19573a691cc87b8d955733574780514a Jul 13 19:40:13.604037 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.603938 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26766f69_fba3_459e_b86b_fc66ba03d5b1.slice/crio-c3dab96c4f4703174c1af439c710e5d3be3e36bff7d910b55ec4d991cf7b1c34 WatchSource:0}: Error finding container c3dab96c4f4703174c1af439c710e5d3be3e36bff7d910b55ec4d991cf7b1c34: Status 404 returned error can't find the container with id c3dab96c4f4703174c1af439c710e5d3be3e36bff7d910b55ec4d991cf7b1c34 Jul 13 19:40:13.606747 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:13.606724 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb907e1ab_a109_4086_880b_17b4f82ec6ff.slice/crio-c8a99d9cea26245ee664658046dfbdd890d57cf08b9204db7104fb3885a18794 WatchSource:0}: Error finding container c8a99d9cea26245ee664658046dfbdd890d57cf08b9204db7104fb3885a18794: Status 404 returned error can't find the container with id c8a99d9cea26245ee664658046dfbdd890d57cf08b9204db7104fb3885a18794 Jul 13 19:40:13.779520 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.779432 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:40:13.960650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.960602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:13.960844 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:13.960680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:13.960844 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.960826 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:13.960969 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.960881 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:14.960866543 +0000 UTC m=+4.073061578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:13.961428 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.961312 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:13.961428 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:13.961392 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:40:14.961373813 +0000 UTC m=+4.073568845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:14.061712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.061121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:14.061712 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.061263 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:14.061712 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.061295 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:14.061712 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.061305 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:14.061712 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.061355 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:40:15.061340741 +0000 UTC m=+4.173535770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:14.298489 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.298404 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 19:35:14 +0000 UTC" deadline="2028-03-15 16:07:58.089627021 +0000 UTC" Jul 13 19:40:14.298489 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.298466 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14660h27m43.791165383s" Jul 13 19:40:14.387724 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.387452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l8szp" event={"ID":"7788da02-52db-4b8a-bf0b-39beec89de4e","Type":"ContainerStarted","Data":"70e4ab4e07cf463634310a005635ce1e19573a691cc87b8d955733574780514a"} Jul 13 19:40:14.389528 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.389496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4qkzc" event={"ID":"23296317-6bbe-4754-8973-ed96f2cb6370","Type":"ContainerStarted","Data":"6c6670222af2168b868e33d88bbcf03724e196fbaa65db5e90715f488060e530"} Jul 13 19:40:14.391467 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.391358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"9ff9000d17933b01cf7f75de90175d4f97059d9221e3ad1eed4c376b4b0c3bba"} Jul 13 19:40:14.396300 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.396273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pxq2p" event={"ID":"9c23a939-29a4-4f33-a40a-8582b2265e9d","Type":"ContainerStarted","Data":"75d2930320276c4180fee3c8dc5e4e84c7339cad9a1e8af8f393dd04e37fca41"} Jul 13 19:40:14.398206 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.398145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k6bh9" event={"ID":"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba","Type":"ContainerStarted","Data":"ad6dfeb47a7adcb4799f1c9ca5e12e19cfb91eb74a3a716e0103a22ee199e8d4"} Jul 13 19:40:14.401644 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.401618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerStarted","Data":"c3dab96c4f4703174c1af439c710e5d3be3e36bff7d910b55ec4d991cf7b1c34"} Jul 13 19:40:14.414584 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.414491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nglhf" event={"ID":"b1f4a4e8-173a-47ab-a4ee-153aa40302bf","Type":"ContainerStarted","Data":"8556d4fa902a555d22c65f2993d506c80c35ac3db559d5005f16c6a9858cb408"} Jul 13 19:40:14.416517 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.416452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fccvh" event={"ID":"9420c69c-39ac-44f2-9b79-2ff1953b1fe5","Type":"ContainerStarted","Data":"4b09cefc8ec35dc1b224cbddc2f19f755e4d32e6a58b9fcb025423ee62f3e709"} Jul 13 19:40:14.418666 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.418577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" event={"ID":"b907e1ab-a109-4086-880b-17b4f82ec6ff","Type":"ContainerStarted","Data":"c8a99d9cea26245ee664658046dfbdd890d57cf08b9204db7104fb3885a18794"} Jul 13 19:40:14.979344 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.979077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:14.979344 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:14.979178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:14.979344 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.979247 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:14.979344 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.979295 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:14.979344 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.979352 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:16.979328233 +0000 UTC m=+6.091523264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:14.979787 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:14.979373 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:40:16.979362743 +0000 UTC m=+6.091557780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:15.080563 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:15.080031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:15.080563 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.080220 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:15.080563 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.080244 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:15.080563 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.080259 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:15.080563 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.080354 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:40:17.080332781 +0000 UTC m=+6.192527832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:15.299172 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:15.299031 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 19:35:14 +0000 UTC" deadline="2027-12-24 14:44:36.753061366 +0000 UTC" Jul 13 19:40:15.299172 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:15.299081 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12691h4m21.453986648s" Jul 13 19:40:15.373681 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:15.373643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:15.373889 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.373820 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:15.374251 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:15.374229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:15.374393 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.374341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:15.374449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:15.374416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:15.374508 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:15.374488 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:17.002589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:17.001712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:17.002589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:17.001802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:17.002589 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.001976 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:17.002589 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.002047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:21.002024732 +0000 UTC m=+10.114219800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:17.002589 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.002493 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:17.002589 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.002551 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:40:21.002533028 +0000 UTC m=+10.114728077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:17.102689 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:17.102640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:17.102887 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.102854 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:17.102887 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.102873 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:17.102887 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.102886 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:17.103057 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.102947 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:40:21.102927805 +0000 UTC m=+10.215122855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:17.377869 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:17.377781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:17.378028 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.377934 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:17.378028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:17.378010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:17.378161 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.378098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:17.378161 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:17.378142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:17.378257 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:17.378203 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:19.376361 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:19.375686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:19.376361 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:19.375808 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:19.376361 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:19.376205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:19.376361 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:19.376310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:19.376948 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:19.376396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:19.376948 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:19.376476 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:21.040329 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:21.040287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:21.040755 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:21.040379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:21.040755 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.040521 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:21.040755 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.040523 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:21.040755 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.040624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:40:29.040602175 +0000 UTC m=+18.152797220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:21.040755 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.040645 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:29.040634994 +0000 UTC m=+18.152830041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:21.140992 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:21.140951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:21.141153 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.141139 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:21.141199 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.141160 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:21.141199 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.141173 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:21.141261 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.141239 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:40:29.141218881 +0000 UTC m=+18.253413929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:21.376086 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:21.375398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:21.376086 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:21.375426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:21.376086 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.375529 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:21.376086 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.375984 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:21.377315 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:21.377280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:21.377514 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:21.377437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:23.375431 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:23.375395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:23.375929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:23.375396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:23.375929 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:23.375526 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:23.375929 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:23.375643 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:23.375929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:23.375711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:23.375929 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:23.375790 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:25.374038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:25.374005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:25.374038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:25.374040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:25.374546 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:25.374006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:25.374546 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:25.374140 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:25.374546 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:25.374198 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:25.374546 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:25.374268 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:27.373508 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:27.373466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:27.373984 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:27.373466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:27.373984 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:27.373606 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:27.373984 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:27.373622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:27.373984 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:27.373687 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:27.373984 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:27.373761 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:29.096385 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:29.096352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:29.096906 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:29.096407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:29.096906 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.096533 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:29.096906 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.096602 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:45.096586406 +0000 UTC m=+34.208781438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:29.096906 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.096533 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:29.096906 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.096678 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:40:45.096664816 +0000 UTC m=+34.208859847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:29.197444 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:29.197407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:29.197640 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.197566 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:29.197640 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.197595 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:29.197640 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.197606 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:29.197791 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.197671 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:40:45.197651894 +0000 UTC m=+34.309846925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:29.373519 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:29.373446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:29.373672 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.373591 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:29.373672 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:29.373611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:29.373672 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:29.373650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:29.373798 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.373726 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:29.373838 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:29.373811 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:31.376674 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:31.376643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:31.376674 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:31.376665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:31.377137 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:31.376660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:31.377137 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:31.376765 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:31.377137 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:31.376838 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:31.377137 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:31.376890 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:33.373486 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:33.373454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:33.373486 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:33.373490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:33.374033 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:33.373455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:33.374033 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:33.373556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:33.374033 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:33.373625 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:33.374033 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:33.373702 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:34.468099 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.467929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" event={"ID":"e03e2aa8c921c7d74e9b77683073fbc0","Type":"ContainerStarted","Data":"79e540eb6551e13e0846a3450649bdacf0af0dfc2c48beef620d02ccd8edeb4d"} Jul 13 19:40:34.472847 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.472818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l8szp" event={"ID":"7788da02-52db-4b8a-bf0b-39beec89de4e","Type":"ContainerStarted","Data":"14b3330601cfe3383886d6d39a97bbf437d080032ada7d2fce7a91fac91d8272"} Jul 13 19:40:34.475473 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.475173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"52df85188f3180bfb020558689c9ddc8663a6f3ec144f745e7f5fa2b50f43fe7"} Jul 13 19:40:34.488723 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.488184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fccvh" event={"ID":"9420c69c-39ac-44f2-9b79-2ff1953b1fe5","Type":"ContainerStarted","Data":"55b54b3fc665133724844cd69a5d9c5b417f315606d9f2af810dc3b7968d9026"} Jul 13 19:40:34.503004 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.502940 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-30.ec2.internal" podStartSLOduration=21.502910939 podStartE2EDuration="21.502910939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:34.4843735 +0000 UTC m=+23.596568549" watchObservedRunningTime="2026-07-13 19:40:34.502910939 +0000 UTC m=+23.615105990" Jul 13 19:40:34.518867 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.518817 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l8szp" podStartSLOduration=1.9125081879999999 podStartE2EDuration="22.51880014s" totalImagesPullingTime="20.606291952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:34.501916245 +0000 UTC m=+23.614111294" watchObservedRunningTime="2026-07-13 19:40:34.51880014 +0000 UTC m=+23.630995201" Jul 13 19:40:34.519021 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:34.518995 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fccvh" podStartSLOduration=1.803441764 podStartE2EDuration="22.518987403s" totalImagesPullingTime="20.715545639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:34.518509247 +0000 UTC m=+23.630704309" watchObservedRunningTime="2026-07-13 19:40:34.518987403 +0000 UTC m=+23.631182454" Jul 13 19:40:35.374769 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.374492 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:35.374929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.374493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:35.374929 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:35.374813 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:35.374929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.374494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:35.374929 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:35.374909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:35.375117 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:35.374983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:35.491668 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.491634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" event={"ID":"b907e1ab-a109-4086-880b-17b4f82ec6ff","Type":"ContainerStarted","Data":"71c7d959aec945fa8ecd7887ba15df3acb90af0bed36754cd8532d311b5d6eb2"} Jul 13 19:40:35.493074 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.493045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4qkzc" event={"ID":"23296317-6bbe-4754-8973-ed96f2cb6370","Type":"ContainerStarted","Data":"0538821097f91c04bc0336ee505689f5141ddc65753a2069d1a1ae5d3ef6ec6b"} Jul 13 19:40:35.496005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.495985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:40:35.496382 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.496328 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7250f25-6011-48c2-a234-e8c7f1a94cbc" containerID="9ab0d6cf05e773ef91870934ff950abdfcceb504480286c1f31ed4835f54ad02" exitCode=1 Jul 13 19:40:35.496439 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.496388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"77cb7ffef0f82b5f0b69a5ef6f1c52f67bfd06dcce50510fbd655329eef1b625"} Jul 13 19:40:35.496480 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.496468 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"996eeb891ff0c30976085f7698dc6bbcc606f7fd5b05695deffa8185cfd712b0"} Jul 13 19:40:35.496534 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.496521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"f091142225c76fa89f46cf7f52b420f6cd48d236ab461f1065947c71b211e2d9"} Jul 13 19:40:35.496593 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.496573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"47246834372cb4c6337361aa559eef92a906da48c0525a71a3f5dfed8046b2b9"} Jul 13 19:40:35.496709 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.496624 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerDied","Data":"9ab0d6cf05e773ef91870934ff950abdfcceb504480286c1f31ed4835f54ad02"} Jul 13 19:40:35.497877 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.497851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k6bh9" event={"ID":"95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba","Type":"ContainerStarted","Data":"8197319124febe106a538bb8b6e84907a2996c18d91044cef0456200969b0250"} Jul 13 19:40:35.499202 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.499181 2576 generic.go:356] "Generic (PLEG): container finished" podID="26766f69-fba3-459e-b86b-fc66ba03d5b1" containerID="9f9e5858f52e3395d44c4404b1e7981d8053fd0e07ced023d17f548dec6c070e" exitCode=0 Jul 13 19:40:35.499297 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.499268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerDied","Data":"9f9e5858f52e3395d44c4404b1e7981d8053fd0e07ced023d17f548dec6c070e"} Jul 13 19:40:35.500812 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.500788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nglhf" event={"ID":"b1f4a4e8-173a-47ab-a4ee-153aa40302bf","Type":"ContainerStarted","Data":"faa5d2fe86fb3ecb40e1155e76585b457f6065380c54bf95d4b2ecfd5950d2f0"} Jul 13 19:40:35.504519 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.502582 2576 generic.go:356] "Generic (PLEG): container finished" podID="d97e35cd5cb8422951c7b954faa30c15" containerID="c16f29a8b30d20564acedb973384c38ef822cf45829c81cfbea2a54a5a8909ca" exitCode=0 Jul 13 19:40:35.504519 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.503090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" event={"ID":"d97e35cd5cb8422951c7b954faa30c15","Type":"ContainerDied","Data":"c16f29a8b30d20564acedb973384c38ef822cf45829c81cfbea2a54a5a8909ca"} Jul 13 19:40:35.513637 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.513593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4qkzc" podStartSLOduration=2.8678930190000003 podStartE2EDuration="23.513578732s" totalImagesPullingTime="20.645685713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:35.51322573 +0000 UTC m=+24.625420781" watchObservedRunningTime="2026-07-13 19:40:35.513578732 +0000 UTC m=+24.625773783" Jul 13 19:40:35.546556 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.546501 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k6bh9" podStartSLOduration=2.914143754 podStartE2EDuration="23.546480348s" totalImagesPullingTime="20.632336594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:35.545903947 +0000 UTC m=+24.658098998" watchObservedRunningTime="2026-07-13 19:40:35.546480348 +0000 UTC m=+24.658675402" Jul 13 19:40:35.563694 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.563645 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nglhf" podStartSLOduration=2.962920315 podStartE2EDuration="23.5636285s" totalImagesPullingTime="20.600708185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:35.563012461 +0000 UTC m=+24.675207517" watchObservedRunningTime="2026-07-13 19:40:35.5636285 +0000 UTC m=+24.675823550" Jul 13 19:40:35.630609 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.630514 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:35.631197 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:35.631170 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:36.133377 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.133347 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 19:40:36.315915 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.315763 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T19:40:36.133369269Z","UUID":"f391c906-9f98-4d40-a534-a474ba2e7fc0","Handler":null,"Name":"","Endpoint":""} Jul 13 19:40:36.317265 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.317230 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 19:40:36.317396 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.317295 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 19:40:36.506999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.506956 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" event={"ID":"d97e35cd5cb8422951c7b954faa30c15","Type":"ContainerStarted","Data":"49e30e3e4a798b4a6ca162514b3da4e41171a16205dec6834385cc8ab252f738"} Jul 13 19:40:36.509085 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.509051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" event={"ID":"b907e1ab-a109-4086-880b-17b4f82ec6ff","Type":"ContainerStarted","Data":"3898be0407292ad19138551ed3ceba81a2cf4e7331a931e6c505d4bdba56fe4e"} Jul 13 19:40:36.510832 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.510804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pxq2p" event={"ID":"9c23a939-29a4-4f33-a40a-8582b2265e9d","Type":"ContainerStarted","Data":"a2658b08bd4a38bf334ffaf810933bad17f4ce8d7a8284cf6959b6f20701f60a"} Jul 13 19:40:36.511164 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.511139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:36.511706 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.511682 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4qkzc" Jul 13 19:40:36.529021 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.528967 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-30.ec2.internal" podStartSLOduration=23.52895227 podStartE2EDuration="23.52895227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:36.528553348 +0000 UTC m=+25.640748399" watchObservedRunningTime="2026-07-13 19:40:36.52895227 +0000 UTC m=+25.641147320" Jul 13 19:40:36.552511 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:36.552447 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pxq2p" podStartSLOduration=8.795091835000001 podStartE2EDuration="24.552426491s" totalImagesPullingTime="15.757334656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:36.552383537 +0000 UTC m=+25.664578588" watchObservedRunningTime="2026-07-13 19:40:36.552426491 +0000 UTC m=+25.664621545" Jul 13 19:40:37.373632 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.373606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:37.373774 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.373648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:37.373774 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:37.373736 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:37.373774 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.373606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:37.373925 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:37.373871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:37.373976 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:37.373958 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:37.515401 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.515325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" event={"ID":"b907e1ab-a109-4086-880b-17b4f82ec6ff","Type":"ContainerStarted","Data":"bd739a9d98378d6a597843137b2a4e5207a23e546aa42f2dff8686eb91dbb881"} Jul 13 19:40:37.519003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.518969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:40:37.519787 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.519761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"735476dfb0c3f40066e488547d233ee2abacc12db209486eca79088acdb09c02"} Jul 13 19:40:37.536837 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:37.536791 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz2hd" podStartSLOduration=2.353414888 podStartE2EDuration="25.536778141s" totalImagesPullingTime="23.183363253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:37.535521152 +0000 UTC m=+26.647716204" watchObservedRunningTime="2026-07-13 19:40:37.536778141 +0000 UTC m=+26.648973192" Jul 13 19:40:39.373786 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:39.373535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:39.374427 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:39.373884 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:39.374427 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:39.373535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:39.374427 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:39.373954 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:39.374427 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:39.373535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:39.374427 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:39.374028 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:40.531161 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.530977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:40:40.531929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.531518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"dc62c6592e5f8c6af372f8d89ae0d1ee98c82991de86b664b0646fef40fe1c57"} Jul 13 19:40:40.531929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.531771 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:40.532001 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.531946 2576 scope.go:117] "RemoveContainer" containerID="9ab0d6cf05e773ef91870934ff950abdfcceb504480286c1f31ed4835f54ad02" Jul 13 19:40:40.534076 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.534054 2576 generic.go:356] "Generic (PLEG): container finished" podID="26766f69-fba3-459e-b86b-fc66ba03d5b1" containerID="7db6c8d79edc45db533304875c0610a23963d4b64b51df6ad557afa153caf415" exitCode=0 Jul 13 19:40:40.534190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.534087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerDied","Data":"7db6c8d79edc45db533304875c0610a23963d4b64b51df6ad557afa153caf415"} Jul 13 19:40:40.548836 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:40.548812 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:41.374825 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.374787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:41.375000 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:41.374880 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:41.375000 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.374899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:41.375000 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.374957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:41.375159 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:41.375032 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:41.375159 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:41.375112 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:41.541618 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.541594 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:40:41.542281 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.541960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" event={"ID":"f7250f25-6011-48c2-a234-e8c7f1a94cbc","Type":"ContainerStarted","Data":"e26431c3abec058a46f84155f0274af2318c8114845d7959e704319f838a6808"} Jul 13 19:40:41.542281 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.542183 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:41.542281 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.542272 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:41.558536 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.558512 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:40:41.574168 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.574119 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" podStartSLOduration=8.855008681 podStartE2EDuration="29.574102924s" totalImagesPullingTime="20.719094243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:41.573772658 +0000 UTC m=+30.685967713" watchObservedRunningTime="2026-07-13 19:40:41.574102924 +0000 UTC m=+30.686297975" Jul 13 19:40:41.931744 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.931714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pqb4t"] Jul 13 19:40:41.931902 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.931858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:41.931962 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:41.931944 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:41.938644 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.938621 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8j9t"] Jul 13 19:40:41.938758 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.938735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:41.938858 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:41.938841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:41.942797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.942775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wkc5n"] Jul 13 19:40:41.942902 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:41.942883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:41.942996 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:41.942973 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:42.545870 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:42.545834 2576 generic.go:356] "Generic (PLEG): container finished" podID="26766f69-fba3-459e-b86b-fc66ba03d5b1" containerID="1604e9b7c6854d62707ca809ba146d0cb30831590fed1695a6897ebc5b2f904e" exitCode=0 Jul 13 19:40:42.546276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:42.545923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerDied","Data":"1604e9b7c6854d62707ca809ba146d0cb30831590fed1695a6897ebc5b2f904e"} Jul 13 19:40:43.373983 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:43.373783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:43.374181 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:43.374091 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:43.374533 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:43.374510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:43.374680 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:43.374618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:43.374739 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:43.374677 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:43.374739 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:43.374603 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:44.552590 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:44.552552 2576 generic.go:356] "Generic (PLEG): container finished" podID="26766f69-fba3-459e-b86b-fc66ba03d5b1" containerID="8796cb2364124e42d84f37be19134824fc9a61be6146cf05bf230a86c8abae82" exitCode=0 Jul 13 19:40:44.553094 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:44.552600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerDied","Data":"8796cb2364124e42d84f37be19134824fc9a61be6146cf05bf230a86c8abae82"} Jul 13 19:40:45.116173 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:45.116130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:45.116415 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:45.116192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:45.116415 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.116301 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:45.116415 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.116312 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:45.116415 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.116354 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret podName:05c816ec-c5a3-490c-84b5-a0acc65f56c4 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:17.116340608 +0000 UTC m=+66.228535636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret") pod "global-pull-secret-syncer-pqb4t" (UID: "05c816ec-c5a3-490c-84b5-a0acc65f56c4") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:40:45.116415 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.116380 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs podName:42f0c7ad-280d-43a2-9ab7-6f96d78e897f nodeName:}" failed. No retries permitted until 2026-07-13 19:41:17.11636172 +0000 UTC m=+66.228556763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs") pod "network-metrics-daemon-r8j9t" (UID: "42f0c7ad-280d-43a2-9ab7-6f96d78e897f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:40:45.217080 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:45.217045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:45.217274 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.217234 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:40:45.217345 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.217285 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:40:45.217345 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.217300 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8hjrn for pod openshift-network-diagnostics/network-check-target-wkc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:45.217448 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.217364 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn podName:ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc nodeName:}" failed. No retries permitted until 2026-07-13 19:41:17.21734462 +0000 UTC m=+66.329539653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8hjrn" (UniqueName: "kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn") pod "network-check-target-wkc5n" (UID: "ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:40:45.373559 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:45.373476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:45.373735 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:45.373478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:45.373735 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.373609 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqb4t" podUID="05c816ec-c5a3-490c-84b5-a0acc65f56c4" Jul 13 19:40:45.373735 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:45.373483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:45.373735 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.373651 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkc5n" podUID="ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc" Jul 13 19:40:45.373947 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:45.373749 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8j9t" podUID="42f0c7ad-280d-43a2-9ab7-6f96d78e897f" Jul 13 19:40:47.199243 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.199161 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-30.ec2.internal" event="NodeReady" Jul 13 19:40:47.199740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.199331 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 19:40:47.243373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.243331 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f745b49f5-c6slk"] Jul 13 19:40:47.248701 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.248659 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn"] Jul 13 19:40:47.248866 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.248804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.251392 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.251363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 19:40:47.251528 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.251377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 19:40:47.252156 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.251975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 19:40:47.252156 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.252002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z5w62\"" Jul 13 19:40:47.252981 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.252953 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p"] Jul 13 19:40:47.252981 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.252963 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" Jul 13 19:40:47.255919 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.255900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.256982 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.256624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c8zg9\"" Jul 13 19:40:47.256982 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.256828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.256982 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.256854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.257713 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.257697 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 19:40:47.259710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.259693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-68jqn\"" Jul 13 19:40:47.261183 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.261166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 19:40:47.261569 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.261546 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.262202 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.261823 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 19:40:47.263757 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.263736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.265072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.265050 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh"] Jul 13 19:40:47.271796 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.271775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn"] Jul 13 19:40:47.271894 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.271810 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq"] Jul 13 19:40:47.272440 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.272420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.275379 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.275360 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 19:40:47.275474 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.275401 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.276140 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.275732 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 19:40:47.276140 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.275915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gd4k4\"" Jul 13 19:40:47.276140 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.276013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.276436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.276395 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss"] Jul 13 19:40:47.277223 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.276733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.279919 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.279899 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.280122 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.280104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.280555 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.280529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 19:40:47.280746 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.280730 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-22tl7\"" Jul 13 19:40:47.280997 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.280972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f745b49f5-c6slk"] Jul 13 19:40:47.281142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.281019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p"] Jul 13 19:40:47.281142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.281047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh"] Jul 13 19:40:47.281142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.281136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:47.281323 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.281136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 19:40:47.285605 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.285584 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hws6d\"" Jul 13 19:40:47.286115 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.286095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 19:40:47.286352 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.286323 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.286549 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.286533 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.289444 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.289423 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq"] Jul 13 19:40:47.289529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.289472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss"] Jul 13 19:40:47.291583 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.291563 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4xz49"] Jul 13 19:40:47.295969 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.295909 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rvr4q"] Jul 13 19:40:47.296069 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.296021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:47.301163 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.301140 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6499879966-8cxc8"] Jul 13 19:40:47.301331 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.301315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.302114 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.302091 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 19:40:47.302236 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.302193 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7wcx9\"" Jul 13 19:40:47.302383 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.302366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 19:40:47.304340 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.304321 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.304436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.304324 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fqg4z\"" Jul 13 19:40:47.304436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.304399 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 19:40:47.304978 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.304836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 19:40:47.305272 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.305215 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.306068 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.306041 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-s8h8b"] Jul 13 19:40:47.306179 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.306138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.309169 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.309147 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 19:40:47.309476 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.309350 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b7n4j"] Jul 13 19:40:47.309476 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.309422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.311808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.310503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 19:40:47.311808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.310539 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 19:40:47.311808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.310713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 19:40:47.311808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.311067 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.312157 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.311926 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hzjp\"" Jul 13 19:40:47.312370 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.312343 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.313691 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.313550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rmmsh\"" Jul 13 19:40:47.317239 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.315584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 19:40:47.317239 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.315813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 19:40:47.317239 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.316119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.317239 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.316540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.317501 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.317326 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 19:40:47.317644 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.317628 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gr8lz"] Jul 13 19:40:47.317904 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.317883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.320725 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.320683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.322644 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.322625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-42b9w\"" Jul 13 19:40:47.322740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.322689 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 19:40:47.322997 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.322980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.323116 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.323101 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt"] Jul 13 19:40:47.323923 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.323902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.325716 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.325696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 19:40:47.326271 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.326234 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 19:40:47.326386 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.326367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-52wb8\"" Jul 13 19:40:47.326746 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.326728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 19:40:47.328417 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4xz49"] Jul 13 19:40:47.328417 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rvr4q"] Jul 13 19:40:47.328617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328430 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gr8lz"] Jul 13 19:40:47.328617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6499879966-8cxc8"] Jul 13 19:40:47.328617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7n4j"] Jul 13 19:40:47.328617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328500 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt"] Jul 13 19:40:47.328617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.328569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" Jul 13 19:40:47.329180 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.329153 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-s8h8b"] Jul 13 19:40:47.331423 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.331408 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 19:40:47.331875 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.331849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.332038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.332020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-installation-pull-secrets\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.332165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.332150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5wbn\" (UniqueName: \"kubernetes.io/projected/e763b060-70e0-4129-aeda-4bbd78420271-kube-api-access-r5wbn\") pod \"volume-data-source-validator-78495597f6-zv9gn\" (UID: \"e763b060-70e0-4129-aeda-4bbd78420271\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" Jul 13 19:40:47.332656 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.332633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-image-registry-private-configuration\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.332757 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.332397 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-drscg\"" Jul 13 19:40:47.332804 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.332528 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 19:40:47.333072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.332670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfb2v\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-kube-api-access-tfb2v\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.333160 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.333143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-bound-sa-token\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.333331 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.333298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-certificates\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.333421 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.333345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-ca-trust-extracted\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.333421 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.333403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-trusted-ca\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.373837 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.373811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:40:47.373966 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.373811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:40:47.374128 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.374103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:40:47.376221 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.376202 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rv6d9\"" Jul 13 19:40:47.376221 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.376212 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 19:40:47.376525 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.376506 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 19:40:47.376604 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.376589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8t4bh\"" Jul 13 19:40:47.434898 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.434842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlqj\" (UniqueName: \"kubernetes.io/projected/48774be2-91c5-4ae1-8080-420ceb196a54-kube-api-access-dxlqj\") pod \"network-check-source-869dcfcdcd-9wjbt\" (UID: \"48774be2-91c5-4ae1-8080-420ceb196a54\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" Jul 13 19:40:47.434898 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.434897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-image-registry-private-configuration\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.434898 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.434927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkzmc\" (UniqueName: \"kubernetes.io/projected/53315d04-852c-42b4-88e5-f7322b19d684-kube-api-access-qkzmc\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.434898 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.434953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g99xw\" (UniqueName: \"kubernetes.io/projected/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-kube-api-access-g99xw\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6rb\" (UniqueName: \"kubernetes.io/projected/585ae350-7e19-4c34-8ceb-64fda6697b08-kube-api-access-sv6rb\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-bound-sa-token\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-certificates\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-ca-trust-extracted\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2c38e98-5d9e-45a1-b02f-b06bef324e6f-cert\") pod \"ingress-canary-b7n4j\" (UID: \"d2c38e98-5d9e-45a1-b02f-b06bef324e6f\") " pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.435353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-trusted-ca\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd74ad67-8477-42a3-a0ae-94356f55ca19-tmp-dir\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd74ad67-8477-42a3-a0ae-94356f55ca19-config-volume\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af54ba5-4deb-4fe4-91a7-8a89474402ea-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.435544 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.435557 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f745b49f5-c6slk: secret "image-registry-tls" not found Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.435605 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls podName:05088faf-7bfc-4cf1-91e1-7beb9091bd9d nodeName:}" failed. No retries permitted until 2026-07-13 19:40:47.935591775 +0000 UTC m=+37.047786803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls") pod "image-registry-7f745b49f5-c6slk" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d") : secret "image-registry-tls" not found Jul 13 19:40:47.435790 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435624 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-ca-trust-extracted\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.436182 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.435871 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-certificates\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.436360 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436337 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-trusted-ca\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.436444 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5wbn\" (UniqueName: \"kubernetes.io/projected/e763b060-70e0-4129-aeda-4bbd78420271-kube-api-access-r5wbn\") pod \"volume-data-source-validator-78495597f6-zv9gn\" (UID: \"e763b060-70e0-4129-aeda-4bbd78420271\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" Jul 13 19:40:47.436444 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-serving-cert\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.436545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-default-certificate\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.436545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfb2v\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-kube-api-access-tfb2v\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.436545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-tmp\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.436545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzzb\" (UniqueName: \"kubernetes.io/projected/cd74ad67-8477-42a3-a0ae-94356f55ca19-kube-api-access-knzzb\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.436545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkj2d\" (UniqueName: \"kubernetes.io/projected/7af54ba5-4deb-4fe4-91a7-8a89474402ea-kube-api-access-mkj2d\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ql2\" (UniqueName: \"kubernetes.io/projected/5cd6e66f-c7c3-40ae-a90b-237bab59d467-kube-api-access-27ql2\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/585ae350-7e19-4c34-8ceb-64fda6697b08-serving-cert\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-stats-auth\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-serving-cert\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-snapshots\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.436801 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbnn\" (UniqueName: \"kubernetes.io/projected/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-kube-api-access-ksbnn\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-config\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53315d04-852c-42b4-88e5-f7322b19d684-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9xd\" (UniqueName: \"kubernetes.io/projected/d2c38e98-5d9e-45a1-b02f-b06bef324e6f-kube-api-access-gj9xd\") pod \"ingress-canary-b7n4j\" (UID: \"d2c38e98-5d9e-45a1-b02f-b06bef324e6f\") " pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgkwz\" (UniqueName: \"kubernetes.io/projected/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-kube-api-access-kgkwz\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.436983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38e14e91-6a0f-4516-82f2-db2c308db3d9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.437008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af54ba5-4deb-4fe4-91a7-8a89474402ea-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.437055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585ae350-7e19-4c34-8ceb-64fda6697b08-trusted-ca\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.437204 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.437195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-installation-pull-secrets\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.437741 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.437232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/585ae350-7e19-4c34-8ceb-64fda6697b08-config\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.439836 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.439816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-image-registry-private-configuration\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.439992 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.439818 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-installation-pull-secrets\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.446154 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.446089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:47.449706 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.449646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-bound-sa-token\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.449830 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.449807 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfb2v\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-kube-api-access-tfb2v\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.449830 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.449815 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5wbn\" (UniqueName: \"kubernetes.io/projected/e763b060-70e0-4129-aeda-4bbd78420271-kube-api-access-r5wbn\") pod \"volume-data-source-validator-78495597f6-zv9gn\" (UID: \"e763b060-70e0-4129-aeda-4bbd78420271\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" Jul 13 19:40:47.537944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.537893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2c38e98-5d9e-45a1-b02f-b06bef324e6f-cert\") pod \"ingress-canary-b7n4j\" (UID: \"d2c38e98-5d9e-45a1-b02f-b06bef324e6f\") " pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.537944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.537944 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd74ad67-8477-42a3-a0ae-94356f55ca19-tmp-dir\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.537988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd74ad67-8477-42a3-a0ae-94356f55ca19-config-volume\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af54ba5-4deb-4fe4-91a7-8a89474402ea-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-serving-cert\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-default-certificate\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-tmp\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.538190 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzzb\" (UniqueName: \"kubernetes.io/projected/cd74ad67-8477-42a3-a0ae-94356f55ca19-kube-api-access-knzzb\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkj2d\" (UniqueName: \"kubernetes.io/projected/7af54ba5-4deb-4fe4-91a7-8a89474402ea-kube-api-access-mkj2d\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ql2\" (UniqueName: \"kubernetes.io/projected/5cd6e66f-c7c3-40ae-a90b-237bab59d467-kube-api-access-27ql2\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/585ae350-7e19-4c34-8ceb-64fda6697b08-serving-cert\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-stats-auth\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-serving-cert\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:47.538589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-snapshots\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.539027 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538672 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-tmp\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.539027 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbnn\" (UniqueName: \"kubernetes.io/projected/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-kube-api-access-ksbnn\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.539027 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-config\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.539027 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.539027 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53315d04-852c-42b4-88e5-f7322b19d684-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9xd\" (UniqueName: \"kubernetes.io/projected/d2c38e98-5d9e-45a1-b02f-b06bef324e6f-kube-api-access-gj9xd\") pod \"ingress-canary-b7n4j\" (UID: \"d2c38e98-5d9e-45a1-b02f-b06bef324e6f\") " pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgkwz\" (UniqueName: \"kubernetes.io/projected/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-kube-api-access-kgkwz\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38e14e91-6a0f-4516-82f2-db2c308db3d9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af54ba5-4deb-4fe4-91a7-8a89474402ea-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585ae350-7e19-4c34-8ceb-64fda6697b08-trusted-ca\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539170 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-snapshots\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.539295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.538330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd74ad67-8477-42a3-a0ae-94356f55ca19-tmp-dir\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.539662 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.539303 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.039284384 +0000 UTC m=+37.151479445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : configmap references non-existent config key: service-ca.crt Jul 13 19:40:47.539946 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.539924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd74ad67-8477-42a3-a0ae-94356f55ca19-config-volume\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.540072 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/585ae350-7e19-4c34-8ceb-64fda6697b08-trusted-ca\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.540395 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af54ba5-4deb-4fe4-91a7-8a89474402ea-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-config\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/585ae350-7e19-4c34-8ceb-64fda6697b08-config\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlqj\" (UniqueName: \"kubernetes.io/projected/48774be2-91c5-4ae1-8080-420ceb196a54-kube-api-access-dxlqj\") pod \"network-check-source-869dcfcdcd-9wjbt\" (UID: \"48774be2-91c5-4ae1-8080-420ceb196a54\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkzmc\" (UniqueName: \"kubernetes.io/projected/53315d04-852c-42b4-88e5-f7322b19d684-kube-api-access-qkzmc\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g99xw\" (UniqueName: \"kubernetes.io/projected/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-kube-api-access-g99xw\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.540947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6rb\" (UniqueName: \"kubernetes.io/projected/585ae350-7e19-4c34-8ceb-64fda6697b08-kube-api-access-sv6rb\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.541017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.541051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541179 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541243 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.041224482 +0000 UTC m=+37.153419513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : secret "router-metrics-certs-default" not found Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.541416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/585ae350-7e19-4c34-8ceb-64fda6697b08-serving-cert\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541514 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541540 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541578 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert podName:38e14e91-6a0f-4516-82f2-db2c308db3d9 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.041556233 +0000 UTC m=+37.153751263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4xz49" (UID: "38e14e91-6a0f-4516-82f2-db2c308db3d9") : secret "networking-console-plugin-cert" not found Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541597 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls podName:53315d04-852c-42b4-88e5-f7322b19d684 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.041587002 +0000 UTC m=+37.153782038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-7qjlq" (UID: "53315d04-852c-42b4-88e5-f7322b19d684") : secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:47.542375 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541648 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.541682 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls podName:cd74ad67-8477-42a3-a0ae-94356f55ca19 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.041671113 +0000 UTC m=+37.153866145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls") pod "dns-default-gr8lz" (UID: "cd74ad67-8477-42a3-a0ae-94356f55ca19") : secret "dns-default-metrics-tls" not found Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.542200 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/585ae350-7e19-4c34-8ceb-64fda6697b08-config\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.542505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53315d04-852c-42b4-88e5-f7322b19d684-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.542543 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.542593 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls podName:5cd6e66f-c7c3-40ae-a90b-237bab59d467 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.042578468 +0000 UTC m=+37.154773500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls") pod "cluster-samples-operator-65db858894-4r4ss" (UID: "5cd6e66f-c7c3-40ae-a90b-237bab59d467") : secret "samples-operator-tls" not found Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.542724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.543093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.543135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38e14e91-6a0f-4516-82f2-db2c308db3d9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.543654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2c38e98-5d9e-45a1-b02f-b06bef324e6f-cert\") pod \"ingress-canary-b7n4j\" (UID: \"d2c38e98-5d9e-45a1-b02f-b06bef324e6f\") " pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.543897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-serving-cert\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.544117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-stats-auth\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.544710 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.544687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af54ba5-4deb-4fe4-91a7-8a89474402ea-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.545477 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.545459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-serving-cert\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.545610 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.545591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-default-certificate\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.554520 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.554213 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzzb\" (UniqueName: \"kubernetes.io/projected/cd74ad67-8477-42a3-a0ae-94356f55ca19-kube-api-access-knzzb\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:47.554520 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.554359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkj2d\" (UniqueName: \"kubernetes.io/projected/7af54ba5-4deb-4fe4-91a7-8a89474402ea-kube-api-access-mkj2d\") pod \"kube-storage-version-migrator-operator-799cb7f958-t294p\" (UID: \"7af54ba5-4deb-4fe4-91a7-8a89474402ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.555878 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.555852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6rb\" (UniqueName: \"kubernetes.io/projected/585ae350-7e19-4c34-8ceb-64fda6697b08-kube-api-access-sv6rb\") pod \"console-operator-7866497494-s8h8b\" (UID: \"585ae350-7e19-4c34-8ceb-64fda6697b08\") " pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.556140 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.556087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbnn\" (UniqueName: \"kubernetes.io/projected/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-kube-api-access-ksbnn\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:47.556757 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.556737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9xd\" (UniqueName: \"kubernetes.io/projected/d2c38e98-5d9e-45a1-b02f-b06bef324e6f-kube-api-access-gj9xd\") pod \"ingress-canary-b7n4j\" (UID: \"d2c38e98-5d9e-45a1-b02f-b06bef324e6f\") " pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.556846 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.556745 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgkwz\" (UniqueName: \"kubernetes.io/projected/9af902ac-ee33-4f13-a579-a80fa4bc0ffa-kube-api-access-kgkwz\") pod \"service-ca-operator-7695fc6c8c-4l9gh\" (UID: \"9af902ac-ee33-4f13-a579-a80fa4bc0ffa\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.556846 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.556798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ql2\" (UniqueName: \"kubernetes.io/projected/5cd6e66f-c7c3-40ae-a90b-237bab59d467-kube-api-access-27ql2\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:47.556989 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.556968 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g99xw\" (UniqueName: \"kubernetes.io/projected/e08f6c3e-9242-4765-9c14-f43ae23d6ae8-kube-api-access-g99xw\") pod \"insights-operator-68d9dd94cf-rvr4q\" (UID: \"e08f6c3e-9242-4765-9c14-f43ae23d6ae8\") " pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.557236 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.557217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlqj\" (UniqueName: \"kubernetes.io/projected/48774be2-91c5-4ae1-8080-420ceb196a54-kube-api-access-dxlqj\") pod \"network-check-source-869dcfcdcd-9wjbt\" (UID: \"48774be2-91c5-4ae1-8080-420ceb196a54\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" Jul 13 19:40:47.558192 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.558171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkzmc\" (UniqueName: \"kubernetes.io/projected/53315d04-852c-42b4-88e5-f7322b19d684-kube-api-access-qkzmc\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:47.570092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.570066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" Jul 13 19:40:47.577178 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.577153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" Jul 13 19:40:47.595086 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.595045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" Jul 13 19:40:47.635005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.634761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" Jul 13 19:40:47.648299 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.648226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:47.656426 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.656399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7n4j" Jul 13 19:40:47.670653 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.670620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" Jul 13 19:40:47.945090 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:47.945050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:47.945321 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.945238 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 19:40:47.945321 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.945277 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f745b49f5-c6slk: secret "image-registry-tls" not found Jul 13 19:40:47.945442 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:47.945348 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls podName:05088faf-7bfc-4cf1-91e1-7beb9091bd9d nodeName:}" failed. No retries permitted until 2026-07-13 19:40:48.945327473 +0000 UTC m=+38.057522501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls") pod "image-registry-7f745b49f5-c6slk" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d") : secret "image-registry-tls" not found Jul 13 19:40:48.046388 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.046345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:48.046558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.046401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:48.046558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.046436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:48.046558 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.046482 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:48.046558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.046498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:48.046558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.046524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:48.046865 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.046562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls podName:53315d04-852c-42b4-88e5-f7322b19d684 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:49.046539991 +0000 UTC m=+38.158735037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-7qjlq" (UID: "53315d04-852c-42b4-88e5-f7322b19d684") : secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:48.046865 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.046814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:48.046966 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.046949 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:40:48.047013 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.046990 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 19:40:48.047061 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047024 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls podName:cd74ad67-8477-42a3-a0ae-94356f55ca19 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:49.047007028 +0000 UTC m=+38.159202062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls") pod "dns-default-gr8lz" (UID: "cd74ad67-8477-42a3-a0ae-94356f55ca19") : secret "dns-default-metrics-tls" not found Jul 13 19:40:48.047061 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047049 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls podName:5cd6e66f-c7c3-40ae-a90b-237bab59d467 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:49.047034921 +0000 UTC m=+38.159229951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls") pod "cluster-samples-operator-65db858894-4r4ss" (UID: "5cd6e66f-c7c3-40ae-a90b-237bab59d467") : secret "samples-operator-tls" not found Jul 13 19:40:48.047160 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047074 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 19:40:48.047160 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047105 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:49.047098274 +0000 UTC m=+38.159293303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : secret "router-metrics-certs-default" not found Jul 13 19:40:48.047160 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047156 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:49.04714652 +0000 UTC m=+38.159341563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : configmap references non-existent config key: service-ca.crt Jul 13 19:40:48.047351 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047164 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 19:40:48.047351 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.047231 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert podName:38e14e91-6a0f-4516-82f2-db2c308db3d9 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:49.047214744 +0000 UTC m=+38.159409788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4xz49" (UID: "38e14e91-6a0f-4516-82f2-db2c308db3d9") : secret "networking-console-plugin-cert" not found Jul 13 19:40:48.472853 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.472818 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:48.573496 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.573456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:48.796780 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.796521 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:48.897947 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.897862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:48.916789 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.916761 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt"] Jul 13 19:40:48.921593 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.921554 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48774be2_91c5_4ae1_8080_420ceb196a54.slice/crio-e5a5cfbf97bd2d09c8d7dd14edf0c48853792a237d1d5219d770c8607f31ba9c WatchSource:0}: Error finding container e5a5cfbf97bd2d09c8d7dd14edf0c48853792a237d1d5219d770c8607f31ba9c: Status 404 returned error can't find the container with id e5a5cfbf97bd2d09c8d7dd14edf0c48853792a237d1d5219d770c8607f31ba9c Jul 13 19:40:48.925617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.925592 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7n4j"] Jul 13 19:40:48.930852 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.930822 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c38e98_5d9e_45a1_b02f_b06bef324e6f.slice/crio-4852a4baa4c1e5db3fe4f88f373a140a0c38a55f54fe4e609c984569f92f0fec WatchSource:0}: Error finding container 4852a4baa4c1e5db3fe4f88f373a140a0c38a55f54fe4e609c984569f92f0fec: Status 404 returned error can't find the container with id 4852a4baa4c1e5db3fe4f88f373a140a0c38a55f54fe4e609c984569f92f0fec Jul 13 19:40:48.939189 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.939164 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh"] Jul 13 19:40:48.941530 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.941508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-s8h8b"] Jul 13 19:40:48.942683 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.942652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p"] Jul 13 19:40:48.943585 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.943564 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rvr4q"] Jul 13 19:40:48.963820 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.963740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn"] Jul 13 19:40:48.966483 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.966457 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af54ba5_4deb_4fe4_91a7_8a89474402ea.slice/crio-f2104c9c9dac5912bb0bcbe15d6ecaa7bda26f121cc51c8db8ce359d9d93149e WatchSource:0}: Error finding container f2104c9c9dac5912bb0bcbe15d6ecaa7bda26f121cc51c8db8ce359d9d93149e: Status 404 returned error can't find the container with id f2104c9c9dac5912bb0bcbe15d6ecaa7bda26f121cc51c8db8ce359d9d93149e Jul 13 19:40:48.967586 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:48.967557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:48.967709 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.967625 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585ae350_7e19_4c34_8ceb_64fda6697b08.slice/crio-bf50b2f8f313959e0774d882b476e3383cd1b05c4fef406d14cb045ba735232a WatchSource:0}: Error finding container bf50b2f8f313959e0774d882b476e3383cd1b05c4fef406d14cb045ba735232a: Status 404 returned error can't find the container with id bf50b2f8f313959e0774d882b476e3383cd1b05c4fef406d14cb045ba735232a Jul 13 19:40:48.967805 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.967788 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 19:40:48.967861 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.967808 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f745b49f5-c6slk: secret "image-registry-tls" not found Jul 13 19:40:48.967923 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:48.967868 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls podName:05088faf-7bfc-4cf1-91e1-7beb9091bd9d nodeName:}" failed. No retries permitted until 2026-07-13 19:40:50.967848777 +0000 UTC m=+40.080043827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls") pod "image-registry-7f745b49f5-c6slk" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d") : secret "image-registry-tls" not found Jul 13 19:40:48.969082 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.969029 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode763b060_70e0_4129_aeda_4bbd78420271.slice/crio-0b7e6796bf14b14b237df47c664f79e0be7e5ae142117443c023a0f24e5757e8 WatchSource:0}: Error finding container 0b7e6796bf14b14b237df47c664f79e0be7e5ae142117443c023a0f24e5757e8: Status 404 returned error can't find the container with id 0b7e6796bf14b14b237df47c664f79e0be7e5ae142117443c023a0f24e5757e8 Jul 13 19:40:48.971100 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.971038 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08f6c3e_9242_4765_9c14_f43ae23d6ae8.slice/crio-78cb6126e6541f2c3a1585650a0ad7ae9cbd96e0afd9ec9fb95ebb80593ea3d3 WatchSource:0}: Error finding container 78cb6126e6541f2c3a1585650a0ad7ae9cbd96e0afd9ec9fb95ebb80593ea3d3: Status 404 returned error can't find the container with id 78cb6126e6541f2c3a1585650a0ad7ae9cbd96e0afd9ec9fb95ebb80593ea3d3 Jul 13 19:40:48.971367 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:40:48.971331 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af902ac_ee33_4f13_a579_a80fa4bc0ffa.slice/crio-9ef5feb035e30bbcaaea82aa706d7b02d421dd301b3855f22c10123ee361670a WatchSource:0}: Error finding container 9ef5feb035e30bbcaaea82aa706d7b02d421dd301b3855f22c10123ee361670a: Status 404 returned error can't find the container with id 9ef5feb035e30bbcaaea82aa706d7b02d421dd301b3855f22c10123ee361670a Jul 13 19:40:49.065123 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.065076 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:49.068197 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.068169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:49.068320 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.068205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:49.068320 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.068231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:49.068320 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.068316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068323 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.068340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.068373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068346 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068422 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068449 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:51.068427749 +0000 UTC m=+40.180622801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : configmap references non-existent config key: service-ca.crt Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068400 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068464 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068491 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls podName:53315d04-852c-42b4-88e5-f7322b19d684 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:51.06848039 +0000 UTC m=+40.180675435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-7qjlq" (UID: "53315d04-852c-42b4-88e5-f7322b19d684") : secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:49.068500 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068508 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls podName:5cd6e66f-c7c3-40ae-a90b-237bab59d467 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:51.068499847 +0000 UTC m=+40.180694877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls") pod "cluster-samples-operator-65db858894-4r4ss" (UID: "5cd6e66f-c7c3-40ae-a90b-237bab59d467") : secret "samples-operator-tls" not found Jul 13 19:40:49.068844 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068526 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:51.068517661 +0000 UTC m=+40.180712714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : secret "router-metrics-certs-default" not found Jul 13 19:40:49.068844 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls podName:cd74ad67-8477-42a3-a0ae-94356f55ca19 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:51.068535883 +0000 UTC m=+40.180730917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls") pod "dns-default-gr8lz" (UID: "cd74ad67-8477-42a3-a0ae-94356f55ca19") : secret "dns-default-metrics-tls" not found Jul 13 19:40:49.068844 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:49.068562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert podName:38e14e91-6a0f-4516-82f2-db2c308db3d9 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:51.06855269 +0000 UTC m=+40.180747726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4xz49" (UID: "38e14e91-6a0f-4516-82f2-db2c308db3d9") : secret "networking-console-plugin-cert" not found Jul 13 19:40:49.167872 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.167839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:49.567141 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.567105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" event={"ID":"48774be2-91c5-4ae1-8080-420ceb196a54","Type":"ContainerStarted","Data":"e5a5cfbf97bd2d09c8d7dd14edf0c48853792a237d1d5219d770c8607f31ba9c"} Jul 13 19:40:49.568104 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.568082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" event={"ID":"7af54ba5-4deb-4fe4-91a7-8a89474402ea","Type":"ContainerStarted","Data":"f2104c9c9dac5912bb0bcbe15d6ecaa7bda26f121cc51c8db8ce359d9d93149e"} Jul 13 19:40:49.570463 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.570438 2576 generic.go:356] "Generic (PLEG): container finished" podID="26766f69-fba3-459e-b86b-fc66ba03d5b1" containerID="aed8bf0aec1fb092768106c1d410c511297d1ea54ee25220e49e296fa82a2fdd" exitCode=0 Jul 13 19:40:49.570564 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.570518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerDied","Data":"aed8bf0aec1fb092768106c1d410c511297d1ea54ee25220e49e296fa82a2fdd"} Jul 13 19:40:49.571605 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.571584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s8h8b" event={"ID":"585ae350-7e19-4c34-8ceb-64fda6697b08","Type":"ContainerStarted","Data":"bf50b2f8f313959e0774d882b476e3383cd1b05c4fef406d14cb045ba735232a"} Jul 13 19:40:49.572569 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.572551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" event={"ID":"9af902ac-ee33-4f13-a579-a80fa4bc0ffa","Type":"ContainerStarted","Data":"9ef5feb035e30bbcaaea82aa706d7b02d421dd301b3855f22c10123ee361670a"} Jul 13 19:40:49.573706 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.573661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" event={"ID":"e763b060-70e0-4129-aeda-4bbd78420271","Type":"ContainerStarted","Data":"0b7e6796bf14b14b237df47c664f79e0be7e5ae142117443c023a0f24e5757e8"} Jul 13 19:40:49.574704 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.574681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7n4j" event={"ID":"d2c38e98-5d9e-45a1-b02f-b06bef324e6f","Type":"ContainerStarted","Data":"4852a4baa4c1e5db3fe4f88f373a140a0c38a55f54fe4e609c984569f92f0fec"} Jul 13 19:40:49.575718 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.575691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" event={"ID":"e08f6c3e-9242-4765-9c14-f43ae23d6ae8","Type":"ContainerStarted","Data":"78cb6126e6541f2c3a1585650a0ad7ae9cbd96e0afd9ec9fb95ebb80593ea3d3"} Jul 13 19:40:49.723683 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:49.723640 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:50.587515 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:50.587479 2576 generic.go:356] "Generic (PLEG): container finished" podID="26766f69-fba3-459e-b86b-fc66ba03d5b1" containerID="fef6e320a194389c6a84ddb1c4e0851fd2340def2ae289072c3b3c7d184d8b11" exitCode=0 Jul 13 19:40:50.587970 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:50.587533 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerDied","Data":"fef6e320a194389c6a84ddb1c4e0851fd2340def2ae289072c3b3c7d184d8b11"} Jul 13 19:40:50.990426 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:50.990368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:50.990624 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:50.990527 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 19:40:50.990624 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:50.990544 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f745b49f5-c6slk: secret "image-registry-tls" not found Jul 13 19:40:50.990624 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:50.990613 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls podName:05088faf-7bfc-4cf1-91e1-7beb9091bd9d nodeName:}" failed. No retries permitted until 2026-07-13 19:40:54.990584178 +0000 UTC m=+44.102779219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls") pod "image-registry-7f745b49f5-c6slk" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d") : secret "image-registry-tls" not found Jul 13 19:40:51.092003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.091746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:51.092182 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.092022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:51.092182 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.092064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:51.092182 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.092134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:51.092182 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.092160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:51.092507 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.092187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:51.092507 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.092380 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 19:40:51.092507 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.092453 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert podName:38e14e91-6a0f-4516-82f2-db2c308db3d9 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:55.092432374 +0000 UTC m=+44.204627420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4xz49" (UID: "38e14e91-6a0f-4516-82f2-db2c308db3d9") : secret "networking-console-plugin-cert" not found Jul 13 19:40:51.092885 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.092863 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:51.093002 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.092923 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls podName:53315d04-852c-42b4-88e5-f7322b19d684 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:55.092907458 +0000 UTC m=+44.205102486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-7qjlq" (UID: "53315d04-852c-42b4-88e5-f7322b19d684") : secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:51.093002 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.092980 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 19:40:51.093120 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.093014 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:55.093002858 +0000 UTC m=+44.205197891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : secret "router-metrics-certs-default" not found Jul 13 19:40:51.093120 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.093079 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:40:55.093069009 +0000 UTC m=+44.205264040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : configmap references non-existent config key: service-ca.crt Jul 13 19:40:51.093226 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.093134 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:40:51.093226 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.093166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls podName:cd74ad67-8477-42a3-a0ae-94356f55ca19 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:55.093156125 +0000 UTC m=+44.205351157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls") pod "dns-default-gr8lz" (UID: "cd74ad67-8477-42a3-a0ae-94356f55ca19") : secret "dns-default-metrics-tls" not found Jul 13 19:40:51.093226 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.093216 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 19:40:51.093474 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:51.093270 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls podName:5cd6e66f-c7c3-40ae-a90b-237bab59d467 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:55.093236351 +0000 UTC m=+44.205431382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls") pod "cluster-samples-operator-65db858894-4r4ss" (UID: "5cd6e66f-c7c3-40ae-a90b-237bab59d467") : secret "samples-operator-tls" not found Jul 13 19:40:51.357810 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.357773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:51.416715 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.416651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:51.597141 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.597083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" event={"ID":"e763b060-70e0-4129-aeda-4bbd78420271","Type":"ContainerStarted","Data":"55aca9cf2cd9b6779dc94262f98b52e28ae55de5aa7cb295167e229f950b3d27"} Jul 13 19:40:51.615623 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.615048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dklm7" event={"ID":"26766f69-fba3-459e-b86b-fc66ba03d5b1","Type":"ContainerStarted","Data":"47fd8c4421d70ca4ee8182c511ff1f18c50590a87b0ab22940072f72ebbb27fd"} Jul 13 19:40:51.619122 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.616434 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zv9gn" podStartSLOduration=11.459459747 podStartE2EDuration="13.616414481s" totalImagesPullingTime="2.156954734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:51.616075122 +0000 UTC m=+40.728270174" watchObservedRunningTime="2026-07-13 19:40:51.616414481 +0000 UTC m=+40.728609535" Jul 13 19:40:51.645309 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.644995 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dklm7" podStartSLOduration=7.945734798 podStartE2EDuration="39.644972105s" totalImagesPullingTime="31.699237307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:51.644197981 +0000 UTC m=+40.756393033" watchObservedRunningTime="2026-07-13 19:40:51.644972105 +0000 UTC m=+40.757167157" Jul 13 19:40:51.652026 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.651991 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:51.770510 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.770420 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:51.870513 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.870480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:51.946092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:51.945957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:54.335338 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:54.335220 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:54.436577 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:54.436491 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:55.024545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.024509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:40:55.024750 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.024706 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 19:40:55.024750 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.024730 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f745b49f5-c6slk: secret "image-registry-tls" not found Jul 13 19:40:55.024866 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.024807 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls podName:05088faf-7bfc-4cf1-91e1-7beb9091bd9d nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.024782383 +0000 UTC m=+52.136977430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls") pod "image-registry-7f745b49f5-c6slk" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d") : secret "image-registry-tls" not found Jul 13 19:40:55.125073 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.125038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:55.125283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.125125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:40:55.125283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.125153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:40:55.125283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.125180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:40:55.125283 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125218 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.125198737 +0000 UTC m=+52.237393789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : configmap references non-existent config key: service-ca.crt Jul 13 19:40:55.125283 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125282 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125283 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125329 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125348 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls podName:cd74ad67-8477-42a3-a0ae-94356f55ca19 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.125330619 +0000 UTC m=+52.237525651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls") pod "dns-default-gr8lz" (UID: "cd74ad67-8477-42a3-a0ae-94356f55ca19") : secret "dns-default-metrics-tls" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125381 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls podName:5cd6e66f-c7c3-40ae-a90b-237bab59d467 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.125365512 +0000 UTC m=+52.237560545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls") pod "cluster-samples-operator-65db858894-4r4ss" (UID: "5cd6e66f-c7c3-40ae-a90b-237bab59d467") : secret "samples-operator-tls" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.125376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125400 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert podName:38e14e91-6a0f-4516-82f2-db2c308db3d9 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.125391217 +0000 UTC m=+52.237586246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4xz49" (UID: "38e14e91-6a0f-4516-82f2-db2c308db3d9") : secret "networking-console-plugin-cert" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125442 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:55.125451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125479 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls podName:53315d04-852c-42b4-88e5-f7322b19d684 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.125467506 +0000 UTC m=+52.237662550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-7qjlq" (UID: "53315d04-852c-42b4-88e5-f7322b19d684") : secret "cluster-monitoring-operator-tls" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125514 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 19:40:55.125568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:55.125546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:41:03.125536086 +0000 UTC m=+52.237731118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : secret "router-metrics-certs-default" not found Jul 13 19:40:57.642742 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.642700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" event={"ID":"48774be2-91c5-4ae1-8080-420ceb196a54","Type":"ContainerStarted","Data":"44b5271324c1e66a876d604a468c52ee3a6ff365a80ffbc59f64430d0487b430"} Jul 13 19:40:57.645177 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.644967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" event={"ID":"7af54ba5-4deb-4fe4-91a7-8a89474402ea","Type":"ContainerStarted","Data":"f44f4e8a1fc88fe60f5b6b6c7e319979d8f08505cb94a5b237284e1fc7ee7fa2"} Jul 13 19:40:57.647150 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.646971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/0.log" Jul 13 19:40:57.647150 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.647015 2576 generic.go:356] "Generic (PLEG): container finished" podID="585ae350-7e19-4c34-8ceb-64fda6697b08" containerID="ee06ec535922712ff507bc87ed78eecee2331ee80922df9dac681f0f2678f071" exitCode=255 Jul 13 19:40:57.647150 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.647093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s8h8b" event={"ID":"585ae350-7e19-4c34-8ceb-64fda6697b08","Type":"ContainerDied","Data":"ee06ec535922712ff507bc87ed78eecee2331ee80922df9dac681f0f2678f071"} Jul 13 19:40:57.648004 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.647855 2576 scope.go:117] "RemoveContainer" containerID="ee06ec535922712ff507bc87ed78eecee2331ee80922df9dac681f0f2678f071" Jul 13 19:40:57.648360 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.648296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:57.648360 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.648332 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:40:57.649838 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.649817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" event={"ID":"9af902ac-ee33-4f13-a579-a80fa4bc0ffa","Type":"ContainerStarted","Data":"a28de12378e2f0643f7d1ceaa092b3c703b616e5f76a22f2de707262ed40f3a2"} Jul 13 19:40:57.651396 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.651369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7n4j" event={"ID":"d2c38e98-5d9e-45a1-b02f-b06bef324e6f","Type":"ContainerStarted","Data":"ebfc0a32d76bcdcceda82bd55be4bae6e192fc6a75afad98c0146daf0991bc6d"} Jul 13 19:40:57.653234 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.653209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" event={"ID":"e08f6c3e-9242-4765-9c14-f43ae23d6ae8","Type":"ContainerStarted","Data":"2143b264963d75beaafe2489e5b9d55eed7b26d3bd5ee2fa85878c6a14805e37"} Jul 13 19:40:57.661833 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.661790 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9wjbt" podStartSLOduration=11.38250561 podStartE2EDuration="19.661774896s" totalImagesPullingTime="8.279269286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:57.660798648 +0000 UTC m=+46.772993700" watchObservedRunningTime="2026-07-13 19:40:57.661774896 +0000 UTC m=+46.773969924" Jul 13 19:40:57.695928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.695877 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b7n4j" podStartSLOduration=2.423682485 podStartE2EDuration="10.695859296s" totalImagesPullingTime="8.272176811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:57.694865458 +0000 UTC m=+46.807060510" watchObservedRunningTime="2026-07-13 19:40:57.695859296 +0000 UTC m=+46.808054373" Jul 13 19:40:57.715142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.715065 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" podStartSLOduration=10.482297746 podStartE2EDuration="18.715039632s" totalImagesPullingTime="8.232741886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:57.712859004 +0000 UTC m=+46.825054056" watchObservedRunningTime="2026-07-13 19:40:57.715039632 +0000 UTC m=+46.827234675" Jul 13 19:40:57.730976 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.730608 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" podStartSLOduration=11.494313232 podStartE2EDuration="19.730585757s" totalImagesPullingTime="8.236272525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:57.73002064 +0000 UTC m=+46.842215688" watchObservedRunningTime="2026-07-13 19:40:57.730585757 +0000 UTC m=+46.842780809" Jul 13 19:40:57.753982 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:57.753919 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" podStartSLOduration=11.515323131 podStartE2EDuration="19.753899042s" totalImagesPullingTime="8.238575911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:57.75344771 +0000 UTC m=+46.865642763" watchObservedRunningTime="2026-07-13 19:40:57.753899042 +0000 UTC m=+46.866094094" Jul 13 19:40:58.396193 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.396157 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sv6gj"] Jul 13 19:40:58.421142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.420211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.421142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.420705 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sv6gj"] Jul 13 19:40:58.423489 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.423463 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 19:40:58.423736 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.423718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5l4sl\"" Jul 13 19:40:58.424941 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.424900 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 19:40:58.425319 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.425290 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:58.457272 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.457206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wk8\" (UniqueName: \"kubernetes.io/projected/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-api-access-r2wk8\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.457461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.457301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.457461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.457370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1a860ee-27b6-46ea-ba75-d4741aed57b3-crio-socket\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.457461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.457408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.457610 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.457481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a860ee-27b6-46ea-ba75-d4741aed57b3-data-volume\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558026 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.557934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.558039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a860ee-27b6-46ea-ba75-d4741aed57b3-data-volume\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558201 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:58.558078 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:40:58.558201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.558127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wk8\" (UniqueName: \"kubernetes.io/projected/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-api-access-r2wk8\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558201 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:58.558159 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:59.058137602 +0000 UTC m=+48.170332638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : configmap "kube-rbac-proxy" not found Jul 13 19:40:58.558434 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.558235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558434 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.558329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1a860ee-27b6-46ea-ba75-d4741aed57b3-crio-socket\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558434 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:58.558388 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:40:58.558568 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:58.558452 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:40:59.058436492 +0000 UTC m=+48.170631524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : secret "insights-runtime-extractor-tls" not found Jul 13 19:40:58.558568 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.558469 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a860ee-27b6-46ea-ba75-d4741aed57b3-data-volume\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.558568 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.558549 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1a860ee-27b6-46ea-ba75-d4741aed57b3-crio-socket\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.571599 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.571570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wk8\" (UniqueName: \"kubernetes.io/projected/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-api-access-r2wk8\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:58.659397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.659363 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:40:58.659880 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.659855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/0.log" Jul 13 19:40:58.659936 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.659917 2576 generic.go:356] "Generic (PLEG): container finished" podID="585ae350-7e19-4c34-8ceb-64fda6697b08" containerID="c6ba59eb25c894f1cfd9216bd848d20adf028d5b8e1cb95d3a5eb1bd302c5401" exitCode=255 Jul 13 19:40:58.660059 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.660022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s8h8b" event={"ID":"585ae350-7e19-4c34-8ceb-64fda6697b08","Type":"ContainerDied","Data":"c6ba59eb25c894f1cfd9216bd848d20adf028d5b8e1cb95d3a5eb1bd302c5401"} Jul 13 19:40:58.660128 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.660105 2576 scope.go:117] "RemoveContainer" containerID="ee06ec535922712ff507bc87ed78eecee2331ee80922df9dac681f0f2678f071" Jul 13 19:40:58.660517 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:58.660497 2576 scope.go:117] "RemoveContainer" containerID="c6ba59eb25c894f1cfd9216bd848d20adf028d5b8e1cb95d3a5eb1bd302c5401" Jul 13 19:40:58.660693 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:58.660672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-s8h8b_openshift-console-operator(585ae350-7e19-4c34-8ceb-64fda6697b08)\"" pod="openshift-console-operator/console-operator-7866497494-s8h8b" podUID="585ae350-7e19-4c34-8ceb-64fda6697b08" Jul 13 19:40:59.064786 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:59.064348 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:40:59.064786 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:59.064433 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:00.064411668 +0000 UTC m=+49.176606699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : configmap "kube-rbac-proxy" not found Jul 13 19:40:59.065044 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.064900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:59.065155 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.065135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:40:59.065333 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:59.065310 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:40:59.065421 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:59.065406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:00.065387411 +0000 UTC m=+49.177582439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : secret "insights-runtime-extractor-tls" not found Jul 13 19:40:59.215296 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.215237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:59.307488 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.307452 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:59.410571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.410488 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:59.508055 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.508020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:59.664065 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.663981 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:40:59.664441 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.664305 2576 scope.go:117] "RemoveContainer" containerID="c6ba59eb25c894f1cfd9216bd848d20adf028d5b8e1cb95d3a5eb1bd302c5401" Jul 13 19:40:59.664484 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:40:59.664462 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-s8h8b_openshift-console-operator(585ae350-7e19-4c34-8ceb-64fda6697b08)\"" pod="openshift-console-operator/console-operator-7866497494-s8h8b" podUID="585ae350-7e19-4c34-8ceb-64fda6697b08" Jul 13 19:40:59.925870 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:40:59.925789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:00.027687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:00.027647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:00.075728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:00.075691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:00.075945 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:00.075819 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:41:00.075945 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:00.075893 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:41:00.075945 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:00.075824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:00.075945 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:00.075907 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:02.075883357 +0000 UTC m=+51.188078403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : configmap "kube-rbac-proxy" not found Jul 13 19:41:00.076200 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:00.075959 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:02.075946016 +0000 UTC m=+51.188141048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : secret "insights-runtime-extractor-tls" not found Jul 13 19:41:00.163897 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:00.163871 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nglhf_b1f4a4e8-173a-47ab-a4ee-153aa40302bf/dns-node-resolver/0.log" Jul 13 19:41:00.949178 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:00.949141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:00.964447 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:00.964422 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6bh9_95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba/node-ca/0.log" Jul 13 19:41:01.009740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:01.009707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:01.564508 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:01.564464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:01.641937 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:01.641907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:01.763983 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:01.763949 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7n4j_d2c38e98-5d9e-45a1-b02f-b06bef324e6f/serve-healthcheck-canary/0.log" Jul 13 19:41:01.952485 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:01.952390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:02.005654 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:02.005618 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:02.095589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:02.095551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:02.095775 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:02.095622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:02.095775 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:02.095694 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:41:02.095775 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:02.095711 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:41:02.095775 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:02.095763 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:06.095744923 +0000 UTC m=+55.207939969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : configmap "kube-rbac-proxy" not found Jul 13 19:41:02.095775 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:02.095777 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:06.095771488 +0000 UTC m=+55.207966517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : secret "insights-runtime-extractor-tls" not found Jul 13 19:41:02.604501 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:02.604465 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:02.666403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:02.666368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:03.105456 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.105418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:41:03.105880 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.105605 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 19:41:03.105880 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.105631 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f745b49f5-c6slk: secret "image-registry-tls" not found Jul 13 19:41:03.105880 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.105697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls podName:05088faf-7bfc-4cf1-91e1-7beb9091bd9d nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.105677017 +0000 UTC m=+68.217872070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls") pod "image-registry-7f745b49f5-c6slk" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d") : secret "image-registry-tls" not found Jul 13 19:41:03.107544 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.107522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:03.206792 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.206749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:41:03.206792 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.206793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.206824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.206913 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.206928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.206953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.206976 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls podName:5cd6e66f-c7c3-40ae-a90b-237bab59d467 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.206960743 +0000 UTC m=+68.319155774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls") pod "cluster-samples-operator-65db858894-4r4ss" (UID: "5cd6e66f-c7c3-40ae-a90b-237bab59d467") : secret "samples-operator-tls" not found Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.206974 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.206918 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:41:03.207011 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207004 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207027 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert podName:38e14e91-6a0f-4516-82f2-db2c308db3d9 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.207013552 +0000 UTC m=+68.319208581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4xz49" (UID: "38e14e91-6a0f-4516-82f2-db2c308db3d9") : secret "networking-console-plugin-cert" not found Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207070 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.207035565 +0000 UTC m=+68.319230620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : secret "router-metrics-certs-default" not found Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.207091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207110 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207146 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls podName:cd74ad67-8477-42a3-a0ae-94356f55ca19 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.207136675 +0000 UTC m=+68.319331703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls") pod "dns-default-gr8lz" (UID: "cd74ad67-8477-42a3-a0ae-94356f55ca19") : secret "dns-default-metrics-tls" not found Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207163 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle podName:002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.207157957 +0000 UTC m=+68.319352986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle") pod "router-default-6499879966-8cxc8" (UID: "002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea") : configmap references non-existent config key: service-ca.crt Jul 13 19:41:03.207414 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:03.207193 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls podName:53315d04-852c-42b4-88e5-f7322b19d684 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:19.207174517 +0000 UTC m=+68.319369558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-7qjlq" (UID: "53315d04-852c-42b4-88e5-f7322b19d684") : secret "cluster-monitoring-operator-tls" not found Jul 13 19:41:03.208698 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:03.208671 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:05.753772 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:05.753721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:05.850998 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:05.850961 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:06.135005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.134913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:06.135005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.134994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:06.135187 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:06.135060 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:41:06.135187 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:06.135123 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls podName:d1a860ee-27b6-46ea-ba75-d4741aed57b3 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:14.135107337 +0000 UTC m=+63.247302366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv6gj" (UID: "d1a860ee-27b6-46ea-ba75-d4741aed57b3") : secret "insights-runtime-extractor-tls" not found Jul 13 19:41:06.135588 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.135567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1a860ee-27b6-46ea-ba75-d4741aed57b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:06.369266 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.369216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:06.471323 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.471274 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:06.567917 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.567886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:06.669702 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.669668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:06.739409 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:06.739319 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:07.648642 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:07.648607 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:41:07.649036 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:07.648678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:41:07.649036 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:07.649027 2576 scope.go:117] "RemoveContainer" containerID="c6ba59eb25c894f1cfd9216bd848d20adf028d5b8e1cb95d3a5eb1bd302c5401" Jul 13 19:41:07.649189 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:07.649171 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-s8h8b_openshift-console-operator(585ae350-7e19-4c34-8ceb-64fda6697b08)\"" pod="openshift-console-operator/console-operator-7866497494-s8h8b" podUID="585ae350-7e19-4c34-8ceb-64fda6697b08" Jul 13 19:41:07.856982 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:07.856945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:08.049571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:08.049518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:08.272569 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:08.272532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:08.442080 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:08.441991 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:08.649355 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:08.649320 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:09.493395 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:09.493361 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:09.647674 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:09.647635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:10.042272 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:10.042219 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:10.375116 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:10.375029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:10.476875 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:10.476840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:10.539498 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:10.539461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:10.643870 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:10.643781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:10.701641 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:10.701605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:11.847224 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:11.847189 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:12.047355 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:12.047301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:12.148749 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:12.148644 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:12.406132 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:12.406037 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:12.504423 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:12.504394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:12.606068 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:12.606035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:12.704754 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:12.704720 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:13.443691 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:13.443650 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:13.567163 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:13.567140 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6frd" Jul 13 19:41:14.039691 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.039648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:14.214367 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.214316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:14.216733 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.216701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1a860ee-27b6-46ea-ba75-d4741aed57b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv6gj\" (UID: \"d1a860ee-27b6-46ea-ba75-d4741aed57b3\") " pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:14.337811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.337726 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5l4sl\"" Jul 13 19:41:14.345430 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.345406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sv6gj" Jul 13 19:41:14.365336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.365310 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:14.478313 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.478278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sv6gj"] Jul 13 19:41:14.482038 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:14.482009 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a860ee_27b6_46ea_ba75_d4741aed57b3.slice/crio-dee16dc5158d68e41c78d9897c3ba20b6972dec6cb99ec0ff23c0fdedc578261 WatchSource:0}: Error finding container dee16dc5158d68e41c78d9897c3ba20b6972dec6cb99ec0ff23c0fdedc578261: Status 404 returned error can't find the container with id dee16dc5158d68e41c78d9897c3ba20b6972dec6cb99ec0ff23c0fdedc578261 Jul 13 19:41:14.643647 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.643568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:14.709320 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.709281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv6gj" event={"ID":"d1a860ee-27b6-46ea-ba75-d4741aed57b3","Type":"ContainerStarted","Data":"dee16dc5158d68e41c78d9897c3ba20b6972dec6cb99ec0ff23c0fdedc578261"} Jul 13 19:41:14.846201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:14.846165 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:15.245227 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:15.245169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:15.842057 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:15.842021 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:16.444474 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:16.444423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:16.637961 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:16.637926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:16.836417 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:16.836380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:17.056268 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.056210 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:17.142899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.142816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:41:17.142899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.142871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:41:17.145650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.145621 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 19:41:17.146548 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.146532 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 19:41:17.156087 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.156058 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05c816ec-c5a3-490c-84b5-a0acc65f56c4-original-pull-secret\") pod \"global-pull-secret-syncer-pqb4t\" (UID: \"05c816ec-c5a3-490c-84b5-a0acc65f56c4\") " pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:41:17.156320 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.156302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f0c7ad-280d-43a2-9ab7-6f96d78e897f-metrics-certs\") pod \"network-metrics-daemon-r8j9t\" (UID: \"42f0c7ad-280d-43a2-9ab7-6f96d78e897f\") " pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:41:17.244480 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.244433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:41:17.247235 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.247208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hjrn\" (UniqueName: \"kubernetes.io/projected/ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc-kube-api-access-8hjrn\") pod \"network-check-target-wkc5n\" (UID: \"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc\") " pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:41:17.389001 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.388975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rv6d9\"" Jul 13 19:41:17.392062 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.392037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqb4t" Jul 13 19:41:17.397138 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.397116 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:41:17.400777 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.400759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8t4bh\"" Jul 13 19:41:17.408791 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:17.408763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8j9t" Jul 13 19:41:18.374740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.374431 2576 scope.go:117] "RemoveContainer" containerID="c6ba59eb25c894f1cfd9216bd848d20adf028d5b8e1cb95d3a5eb1bd302c5401" Jul 13 19:41:18.433077 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.433038 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wkc5n"] Jul 13 19:41:18.437287 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:18.437231 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3db594_ef88_44a7_8e8e_5eb9e1ef54fc.slice/crio-265daadc84f211003f2dcf762a90b6d3d696d1a39fe77ce7423b4da6533e2838 WatchSource:0}: Error finding container 265daadc84f211003f2dcf762a90b6d3d696d1a39fe77ce7423b4da6533e2838: Status 404 returned error can't find the container with id 265daadc84f211003f2dcf762a90b6d3d696d1a39fe77ce7423b4da6533e2838 Jul 13 19:41:18.461507 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.461484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8j9t"] Jul 13 19:41:18.467550 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:18.467501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f0c7ad_280d_43a2_9ab7_6f96d78e897f.slice/crio-478a472ca0f1d84d97d4e715a463987cf08b64babcd1b02cd9a9b09b71356c32 WatchSource:0}: Error finding container 478a472ca0f1d84d97d4e715a463987cf08b64babcd1b02cd9a9b09b71356c32: Status 404 returned error can't find the container with id 478a472ca0f1d84d97d4e715a463987cf08b64babcd1b02cd9a9b09b71356c32 Jul 13 19:41:18.480399 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.480351 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pqb4t"] Jul 13 19:41:18.725900 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.725874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:41:18.726080 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.725964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s8h8b" event={"ID":"585ae350-7e19-4c34-8ceb-64fda6697b08","Type":"ContainerStarted","Data":"022eee25bc2c665b6dfd41c03172e492669db8a450eed82afd7be1c1aed103a5"} Jul 13 19:41:18.726313 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.726293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:41:18.727562 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.727530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv6gj" event={"ID":"d1a860ee-27b6-46ea-ba75-d4741aed57b3","Type":"ContainerStarted","Data":"4e02db3c532b0b06b6e600970d6e5ac2eb902814dbd88a1f660517212942004a"} Jul 13 19:41:18.728766 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.728745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8j9t" event={"ID":"42f0c7ad-280d-43a2-9ab7-6f96d78e897f","Type":"ContainerStarted","Data":"478a472ca0f1d84d97d4e715a463987cf08b64babcd1b02cd9a9b09b71356c32"} Jul 13 19:41:18.730272 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.730221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wkc5n" event={"ID":"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc","Type":"ContainerStarted","Data":"ba05f7959bc65d04f27195b4d374d4507a11e2f0421da8d2d4b9fe742898e7bd"} Jul 13 19:41:18.730382 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.730297 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:41:18.730382 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.730319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wkc5n" event={"ID":"ea3db594-ef88-44a7-8e8e-5eb9e1ef54fc","Type":"ContainerStarted","Data":"265daadc84f211003f2dcf762a90b6d3d696d1a39fe77ce7423b4da6533e2838"} Jul 13 19:41:18.731395 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.731375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pqb4t" event={"ID":"05c816ec-c5a3-490c-84b5-a0acc65f56c4","Type":"ContainerStarted","Data":"3735892254a04021c2b29eb4f6ee58f79e991bc7b51040ce6527d34866ab281c"} Jul 13 19:41:18.744773 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.744718 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-s8h8b" podStartSLOduration=31.509503383 podStartE2EDuration="39.744697618s" totalImagesPullingTime="8.235194235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:18.742942906 +0000 UTC m=+67.855137998" watchObservedRunningTime="2026-07-13 19:41:18.744697618 +0000 UTC m=+67.856892669" Jul 13 19:41:18.757543 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:18.757491 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wkc5n" podStartSLOduration=66.757474997 podStartE2EDuration="1m6.757474997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:18.756659932 +0000 UTC m=+67.868854982" watchObservedRunningTime="2026-07-13 19:41:18.757474997 +0000 UTC m=+67.869670047" Jul 13 19:41:19.165932 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.165846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:41:19.168609 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.168574 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"image-registry-7f745b49f5-c6slk\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:41:19.267201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.267155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:41:19.267402 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.267210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:41:19.267402 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.267383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:41:19.267513 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.267496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:41:19.267563 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.267526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:19.267614 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.267562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:19.268549 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.268496 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-service-ca-bundle\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:19.270349 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.270301 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd6e66f-c7c3-40ae-a90b-237bab59d467-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4r4ss\" (UID: \"5cd6e66f-c7c3-40ae-a90b-237bab59d467\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:41:19.270560 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.270530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38e14e91-6a0f-4516-82f2-db2c308db3d9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xz49\" (UID: \"38e14e91-6a0f-4516-82f2-db2c308db3d9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:41:19.270704 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.270681 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53315d04-852c-42b4-88e5-f7322b19d684-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-7qjlq\" (UID: \"53315d04-852c-42b4-88e5-f7322b19d684\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:41:19.270917 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.270878 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea-metrics-certs\") pod \"router-default-6499879966-8cxc8\" (UID: \"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea\") " pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:19.271763 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.271739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd74ad67-8477-42a3-a0ae-94356f55ca19-metrics-tls\") pod \"dns-default-gr8lz\" (UID: \"cd74ad67-8477-42a3-a0ae-94356f55ca19\") " pod="openshift-dns/dns-default-gr8lz" Jul 13 19:41:19.366629 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.366593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z5w62\"" Jul 13 19:41:19.373956 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.373919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:41:19.400343 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.400319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-s8h8b" Jul 13 19:41:19.406900 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.406567 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-22tl7\"" Jul 13 19:41:19.414889 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.414857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" Jul 13 19:41:19.421759 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.421133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hws6d\"" Jul 13 19:41:19.426809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.426707 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" Jul 13 19:41:19.429055 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.429005 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7wcx9\"" Jul 13 19:41:19.437351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.437321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" Jul 13 19:41:19.445310 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.445279 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hzjp\"" Jul 13 19:41:19.452590 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.452493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:19.466138 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.466106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-52wb8\"" Jul 13 19:41:19.474886 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.474855 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gr8lz" Jul 13 19:41:19.607828 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.607780 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:19.707673 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.707634 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:19.760928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.760632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:19.876105 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:19.876068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:20.096512 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.093310 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:20.214912 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.214831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss"] Jul 13 19:41:20.246622 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.246274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4xz49"] Jul 13 19:41:20.269491 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.269460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:20.275730 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.275694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f745b49f5-c6slk"] Jul 13 19:41:20.500155 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.500076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq"] Jul 13 19:41:20.503045 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:20.503017 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53315d04_852c_42b4_88e5_f7322b19d684.slice/crio-b4e46f6951862138be8a743650ab0b82a1ca40e3a01a15bff39b1f68e1d2da58 WatchSource:0}: Error finding container b4e46f6951862138be8a743650ab0b82a1ca40e3a01a15bff39b1f68e1d2da58: Status 404 returned error can't find the container with id b4e46f6951862138be8a743650ab0b82a1ca40e3a01a15bff39b1f68e1d2da58 Jul 13 19:41:20.506411 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.506340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gr8lz"] Jul 13 19:41:20.507954 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.507925 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6499879966-8cxc8"] Jul 13 19:41:20.512059 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:20.512029 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002d33f7_e5a1_4fc8_b0c2_f2d5f07824ea.slice/crio-1606cd3ce42260e9f2f7161528824bf52783b24d3363ca4ccf20c0770ef74f0c WatchSource:0}: Error finding container 1606cd3ce42260e9f2f7161528824bf52783b24d3363ca4ccf20c0770ef74f0c: Status 404 returned error can't find the container with id 1606cd3ce42260e9f2f7161528824bf52783b24d3363ca4ccf20c0770ef74f0c Jul 13 19:41:20.512307 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:20.512283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd74ad67_8477_42a3_a0ae_94356f55ca19.slice/crio-1a4bbae9d7946396cd179508ea63f9f28d820d07339934c712d775ebe6a61747 WatchSource:0}: Error finding container 1a4bbae9d7946396cd179508ea63f9f28d820d07339934c712d775ebe6a61747: Status 404 returned error can't find the container with id 1a4bbae9d7946396cd179508ea63f9f28d820d07339934c712d775ebe6a61747 Jul 13 19:41:20.656340 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.656288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:20.711806 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.711733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:20.741346 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.741299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gr8lz" event={"ID":"cd74ad67-8477-42a3-a0ae-94356f55ca19","Type":"ContainerStarted","Data":"1a4bbae9d7946396cd179508ea63f9f28d820d07339934c712d775ebe6a61747"} Jul 13 19:41:20.743413 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.743332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" event={"ID":"05088faf-7bfc-4cf1-91e1-7beb9091bd9d","Type":"ContainerStarted","Data":"8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e"} Jul 13 19:41:20.743413 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.743383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" event={"ID":"05088faf-7bfc-4cf1-91e1-7beb9091bd9d","Type":"ContainerStarted","Data":"5fd65d56df9e5e79caca4a628b2d9ed3849ce1c555be1fe0ac5bbd10ca320eb9"} Jul 13 19:41:20.743684 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.743666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:41:20.745024 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.744967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" event={"ID":"5cd6e66f-c7c3-40ae-a90b-237bab59d467","Type":"ContainerStarted","Data":"ed911e3efa7e4502a651d8d1539ebccdd242867ea6555d8d3c679a4f4646de68"} Jul 13 19:41:20.746314 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.746260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" event={"ID":"38e14e91-6a0f-4516-82f2-db2c308db3d9","Type":"ContainerStarted","Data":"9a48ddce52ebebd31cbb149c0169c9532d9a5cc33161769b801c3b7ec798ee29"} Jul 13 19:41:20.748616 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.748586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv6gj" event={"ID":"d1a860ee-27b6-46ea-ba75-d4741aed57b3","Type":"ContainerStarted","Data":"25342a88b0d9f87c4a65c1b06c1eb2b7f1e01388de8e353256ef18c345be3d10"} Jul 13 19:41:20.750600 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.750530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8j9t" event={"ID":"42f0c7ad-280d-43a2-9ab7-6f96d78e897f","Type":"ContainerStarted","Data":"ec60270ccb8e218958811e2e1919bdb666cdac8100209e403b9ec03d94396b6b"} Jul 13 19:41:20.750600 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.750584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8j9t" event={"ID":"42f0c7ad-280d-43a2-9ab7-6f96d78e897f","Type":"ContainerStarted","Data":"af37b9a86880635dfe08d929af4c49b97e3c1bc6df58d6daee5ab52f03a315f3"} Jul 13 19:41:20.751647 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.751627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" event={"ID":"53315d04-852c-42b4-88e5-f7322b19d684","Type":"ContainerStarted","Data":"b4e46f6951862138be8a743650ab0b82a1ca40e3a01a15bff39b1f68e1d2da58"} Jul 13 19:41:20.753091 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.753071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6499879966-8cxc8" event={"ID":"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea","Type":"ContainerStarted","Data":"92750af0b04ca52745ced47a2abf4181f9416e9de2b591d8db003db4e21952e2"} Jul 13 19:41:20.753172 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.753107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6499879966-8cxc8" event={"ID":"002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea","Type":"ContainerStarted","Data":"1606cd3ce42260e9f2f7161528824bf52783b24d3363ca4ccf20c0770ef74f0c"} Jul 13 19:41:20.765146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.764894 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" podStartSLOduration=68.764876702 podStartE2EDuration="1m8.764876702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:20.76408036 +0000 UTC m=+69.876275412" watchObservedRunningTime="2026-07-13 19:41:20.764876702 +0000 UTC m=+69.877071793" Jul 13 19:41:20.781946 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.781895 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6499879966-8cxc8" podStartSLOduration=41.781873527 podStartE2EDuration="41.781873527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:20.781340531 +0000 UTC m=+69.893535584" watchObservedRunningTime="2026-07-13 19:41:20.781873527 +0000 UTC m=+69.894068557" Jul 13 19:41:20.799061 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:20.798989 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r8j9t" podStartSLOduration=67.27667323 podStartE2EDuration="1m8.798966701s" totalImagesPullingTime="1.522293471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:20.797950396 +0000 UTC m=+69.910145448" watchObservedRunningTime="2026-07-13 19:41:20.798966701 +0000 UTC m=+69.911161762" Jul 13 19:41:21.054746 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.054647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:21.158295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.158241 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:21.270873 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.270819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:21.371396 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.371317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:21.428183 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.428098 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:21.455403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.455372 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:21.457706 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.457676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:21.668985 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.668869 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:21.761934 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.761900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:21.763575 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:21.763384 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6499879966-8cxc8" Jul 13 19:41:22.020649 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:22.020571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:22.488939 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:22.488887 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:22.583043 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:22.583005 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:22.885824 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:22.885739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:22.948002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:22.947962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:26.772390 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.772351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:26.780995 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.780963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" event={"ID":"53315d04-852c-42b4-88e5-f7322b19d684","Type":"ContainerStarted","Data":"b02e0f4f4754adf8e9081d82f2fb250e3ef97fef66250f9331ef7d6d440ee1e3"} Jul 13 19:41:26.787798 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.783566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gr8lz" event={"ID":"cd74ad67-8477-42a3-a0ae-94356f55ca19","Type":"ContainerStarted","Data":"e69942a2eafb917a64ee33adaf9e1c38f9caed5fde192471995c8537e1417cac"} Jul 13 19:41:26.787798 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.783668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gr8lz" event={"ID":"cd74ad67-8477-42a3-a0ae-94356f55ca19","Type":"ContainerStarted","Data":"7b74cec6fbf9e0f568a7b0944adc6c8997049cbcbf11ebf70c23af28de776e3a"} Jul 13 19:41:26.787798 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.783724 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gr8lz" Jul 13 19:41:26.789977 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.789953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" event={"ID":"5cd6e66f-c7c3-40ae-a90b-237bab59d467","Type":"ContainerStarted","Data":"75fa30768fdf67c7a3358d8da9c42b3f896faa8819f0486c31f49482515eed31"} Jul 13 19:41:26.790115 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.790003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" event={"ID":"5cd6e66f-c7c3-40ae-a90b-237bab59d467","Type":"ContainerStarted","Data":"bf6f736290d4a2d63c069d7741a548a708d6eb20ed459e29e8812317771c3797"} Jul 13 19:41:26.791461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.791438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" event={"ID":"38e14e91-6a0f-4516-82f2-db2c308db3d9","Type":"ContainerStarted","Data":"f4ef0057a63306ea8ecd2ff3543167bae638fe2f2e316dea3e6964947db2cb31"} Jul 13 19:41:26.793571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.793543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv6gj" event={"ID":"d1a860ee-27b6-46ea-ba75-d4741aed57b3","Type":"ContainerStarted","Data":"0eb307cfa229385d064a2ab026570febf8ba918212f4d9745e0acc18d9580dc2"} Jul 13 19:41:26.794945 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.794913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pqb4t" event={"ID":"05c816ec-c5a3-490c-84b5-a0acc65f56c4","Type":"ContainerStarted","Data":"cf8f77e36b06f656fd1068f07f32893430bfc169039210d9182858d38d3f5748"} Jul 13 19:41:26.800738 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.800691 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-7qjlq" podStartSLOduration=42.938735185 podStartE2EDuration="48.800673997s" totalImagesPullingTime="5.861938812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:26.800211922 +0000 UTC m=+75.912406973" watchObservedRunningTime="2026-07-13 19:41:26.800673997 +0000 UTC m=+75.912869049" Jul 13 19:41:26.817873 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.817819 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sv6gj" podStartSLOduration=17.305081431 podStartE2EDuration="28.81779822s" totalImagesPullingTime="11.512716789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:26.816936701 +0000 UTC m=+75.929131755" watchObservedRunningTime="2026-07-13 19:41:26.81779822 +0000 UTC m=+75.929993305" Jul 13 19:41:26.834717 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.834653 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4r4ss" podStartSLOduration=42.790669538 podStartE2EDuration="48.834637968s" totalImagesPullingTime="6.04396843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:26.833321246 +0000 UTC m=+75.945516298" watchObservedRunningTime="2026-07-13 19:41:26.834637968 +0000 UTC m=+75.946833019" Jul 13 19:41:26.838014 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.837987 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:26.852983 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.852892 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xz49" podStartSLOduration=41.747661682 podStartE2EDuration="47.852872675s" totalImagesPullingTime="6.105210993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:26.851485788 +0000 UTC m=+75.963680875" watchObservedRunningTime="2026-07-13 19:41:26.852872675 +0000 UTC m=+75.965067728" Jul 13 19:41:26.872388 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.872337 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gr8lz" podStartSLOduration=34.021762783 podStartE2EDuration="39.872320913s" totalImagesPullingTime="5.85055813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:26.870852485 +0000 UTC m=+75.983047537" watchObservedRunningTime="2026-07-13 19:41:26.872320913 +0000 UTC m=+75.984515964" Jul 13 19:41:26.890409 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.890349 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pqb4t" podStartSLOduration=66.996222889 podStartE2EDuration="1m14.890330103s" totalImagesPullingTime="7.894107214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:26.888738421 +0000 UTC m=+76.000933470" watchObservedRunningTime="2026-07-13 19:41:26.890330103 +0000 UTC m=+76.002525154" Jul 13 19:41:26.961752 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:26.961708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:27.029019 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:27.028984 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:27.389555 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:27.389518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:27.779659 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:27.779614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:27.860081 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:27.860042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:28.124000 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:28.123904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:28.179787 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:28.179756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:28.532810 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:28.532782 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:28.593197 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:28.593160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:28.698716 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:28.698669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:28.762375 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:28.762340 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:29.726887 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:29.726855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:29.827633 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:29.827597 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:30.998667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:30.998633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:31.099873 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:31.099831 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:31.217530 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:31.217497 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:31.986584 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:31.986442 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:32.044232 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:32.044196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:35.456589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:35.456550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:35.515556 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:35.515521 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:36.803794 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:36.803769 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gr8lz" Jul 13 19:41:37.734616 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:37.734575 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:37.800967 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:37.800927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:39.378159 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:39.378122 2576 patch_prober.go:28] interesting pod/image-registry-7f745b49f5-c6slk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 19:41:39.378630 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:39.378183 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" podUID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 19:41:40.976640 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:40.976603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:41.037336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:41.037296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:41.766961 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:41.766936 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:41:42.183558 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:42.183462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:42.251272 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:42.251213 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:44.876529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:44.876494 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f745b49f5-c6slk"] Jul 13 19:41:44.990129 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:44.990079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:45.098306 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:45.098274 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:45.193765 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:45.193668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:45.340075 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:45.340038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:45.894948 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:45.894919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:45.957603 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:45.957572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.128883 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.128850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.330356 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.330318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.354594 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.354560 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv"] Jul 13 19:41:48.359214 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.359192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.362153 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.362128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mvpww\"" Jul 13 19:41:48.363181 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.363152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 19:41:48.363297 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.363207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 19:41:48.363297 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.363153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 19:41:48.373306 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.370889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv"] Jul 13 19:41:48.394505 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.394410 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fdg26"] Jul 13 19:41:48.396462 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.396435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd261b02-81cf-4399-aef1-079fc74ae101-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.396598 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.396519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd261b02-81cf-4399-aef1-079fc74ae101-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.396598 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.396578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd261b02-81cf-4399-aef1-079fc74ae101-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.396598 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.396594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djlr\" (UniqueName: \"kubernetes.io/projected/bd261b02-81cf-4399-aef1-079fc74ae101-kube-api-access-7djlr\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.398132 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.398108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.402261 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.402213 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 19:41:48.402447 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.402429 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 19:41:48.402526 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.402462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 19:41:48.402583 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.402543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vzrmk\"" Jul 13 19:41:48.430560 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.430518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.491879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.491843 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.497874 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.497845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-root\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.497969 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.497878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-wtmp\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.497969 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.497902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd261b02-81cf-4399-aef1-079fc74ae101-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.497969 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.497957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djlr\" (UniqueName: \"kubernetes.io/projected/bd261b02-81cf-4399-aef1-079fc74ae101-kube-api-access-7djlr\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.498071 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.497984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-metrics-client-ca\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498071 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498071 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd261b02-81cf-4399-aef1-079fc74ae101-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.498185 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-textfile\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498185 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-tls\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498185 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd261b02-81cf-4399-aef1-079fc74ae101-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.498344 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-sys\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498344 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd5wl\" (UniqueName: \"kubernetes.io/projected/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-kube-api-access-jd5wl\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498344 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.498825 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.498800 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd261b02-81cf-4399-aef1-079fc74ae101-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.500678 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.500654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd261b02-81cf-4399-aef1-079fc74ae101-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.500678 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.500670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd261b02-81cf-4399-aef1-079fc74ae101-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.506858 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.506837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djlr\" (UniqueName: \"kubernetes.io/projected/bd261b02-81cf-4399-aef1-079fc74ae101-kube-api-access-7djlr\") pod \"openshift-state-metrics-84bd68b896-bs7xv\" (UID: \"bd261b02-81cf-4399-aef1-079fc74ae101\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.594511 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.594475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.599570 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-sys\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599683 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd5wl\" (UniqueName: \"kubernetes.io/projected/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-kube-api-access-jd5wl\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599683 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599683 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-sys\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599683 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-root\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599816 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-root\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599816 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-wtmp\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599816 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-metrics-client-ca\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599816 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.599816 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-textfile\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.600040 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599832 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-wtmp\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.600040 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.599864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-tls\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.600040 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:48.600008 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 19:41:48.600195 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:48.600071 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-tls podName:519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:49.100048581 +0000 UTC m=+98.212243613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-tls") pod "node-exporter-fdg26" (UID: "519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0") : secret "node-exporter-tls" not found Jul 13 19:41:48.600273 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.600241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-textfile\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.600463 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.600443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.600599 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.600473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-metrics-client-ca\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.602287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.602271 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.608413 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.608391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd5wl\" (UniqueName: \"kubernetes.io/projected/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-kube-api-access-jd5wl\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:48.669863 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.669776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" Jul 13 19:41:48.695160 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.695095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.795310 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.795272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:48.818732 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.818659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv"] Jul 13 19:41:48.821363 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:48.821332 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd261b02_81cf_4399_aef1_079fc74ae101.slice/crio-0d1c11683d728e3d82dd49028a874d1369c3c7da48777063d2d9850e4a401899 WatchSource:0}: Error finding container 0d1c11683d728e3d82dd49028a874d1369c3c7da48777063d2d9850e4a401899: Status 404 returned error can't find the container with id 0d1c11683d728e3d82dd49028a874d1369c3c7da48777063d2d9850e4a401899 Jul 13 19:41:48.883073 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:48.883043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" event={"ID":"bd261b02-81cf-4399-aef1-079fc74ae101","Type":"ContainerStarted","Data":"0d1c11683d728e3d82dd49028a874d1369c3c7da48777063d2d9850e4a401899"} Jul 13 19:41:49.042352 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.042311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:49.105606 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.105574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-tls\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:49.108034 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.108008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0-node-exporter-tls\") pod \"node-exporter-fdg26\" (UID: \"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0\") " pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:49.307087 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.307048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdg26" Jul 13 19:41:49.337313 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.337275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:49.396266 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:49.396223 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519d37e1_bcf3_42f2_8ab5_b7fd62b9b3c0.slice/crio-5f9400bce52e4aeba9195e0cc9683571710cee25050dea7a85fd1783bea3aeb6 WatchSource:0}: Error finding container 5f9400bce52e4aeba9195e0cc9683571710cee25050dea7a85fd1783bea3aeb6: Status 404 returned error can't find the container with id 5f9400bce52e4aeba9195e0cc9683571710cee25050dea7a85fd1783bea3aeb6 Jul 13 19:41:49.433968 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.433929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:49.440143 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.440110 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:41:49.466881 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.466845 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:41:49.467036 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.466952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.469757 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.469730 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 19:41:49.470157 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 19:41:49.470532 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 19:41:49.470643 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470551 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 19:41:49.470643 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 19:41:49.470766 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470653 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 19:41:49.470820 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 19:41:49.470874 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 19:41:49.470924 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 19:41:49.470975 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.470966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ddmwc\"" Jul 13 19:41:49.501693 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.501656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:49.508883 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.508851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509012 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.508898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-volume\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509012 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.508928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-out\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509012 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.508954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-web-config\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509012 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.508977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrk6q\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-kube-api-access-vrk6q\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509174 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509401 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.509401 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.509226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.568445 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.568359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:49.610684 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.610639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.610874 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.610692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-volume\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.610874 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.610739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-out\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.610874 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.610765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-web-config\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.610874 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.610816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrk6q\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-kube-api-access-vrk6q\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.611615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.612002 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:49.611857 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle podName:1382af70-8e7a-4c75-bd1f-0ef7d03cacf8 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:50.111747098 +0000 UTC m=+99.223942132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8") : configmap references non-existent config key: ca-bundle.crt Jul 13 19:41:49.614133 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.614085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-out\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.615045 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.615017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-web-config\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.615145 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.615029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.615348 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.615324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.615716 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.615696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.615864 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.615846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-volume\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.615917 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.615845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.616365 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.616330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.616813 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.616795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.625200 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.625173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrk6q\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-kube-api-access-vrk6q\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:49.739263 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.739215 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wkc5n" Jul 13 19:41:49.859075 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.858974 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:49.889811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.889772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" event={"ID":"bd261b02-81cf-4399-aef1-079fc74ae101","Type":"ContainerStarted","Data":"f39eba6fd26cf7c85e49b72f6447007af59fbb7cdbfb136b6970a0f517c758c8"} Jul 13 19:41:49.889984 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.889847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" event={"ID":"bd261b02-81cf-4399-aef1-079fc74ae101","Type":"ContainerStarted","Data":"5f07147568ea64bd8d1c6001a044e22d778ddb57325a2ebd0de42cba41e5b61e"} Jul 13 19:41:49.890914 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.890890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdg26" event={"ID":"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0","Type":"ContainerStarted","Data":"5f9400bce52e4aeba9195e0cc9683571710cee25050dea7a85fd1783bea3aeb6"} Jul 13 19:41:49.960737 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:49.960693 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:50.059002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.058958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:50.118577 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.118494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:50.119384 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.119359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:50.378554 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.378467 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:41:50.734151 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.734128 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:41:50.900055 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.899957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" event={"ID":"bd261b02-81cf-4399-aef1-079fc74ae101","Type":"ContainerStarted","Data":"b772be5dc7f67baae7d674cdd7a2bfbeaca24b8ba15cda50614e8c430541a31b"} Jul 13 19:41:50.918285 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:50.918223 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1382af70_8e7a_4c75_bd1f_0ef7d03cacf8.slice/crio-eb00eaf8c06b8fb081f2a19a90154b7ef3fc4ba079d7bbd8d3d76d0501bf23a5 WatchSource:0}: Error finding container eb00eaf8c06b8fb081f2a19a90154b7ef3fc4ba079d7bbd8d3d76d0501bf23a5: Status 404 returned error can't find the container with id eb00eaf8c06b8fb081f2a19a90154b7ef3fc4ba079d7bbd8d3d76d0501bf23a5 Jul 13 19:41:50.919038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:50.918987 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bs7xv" podStartSLOduration=1.296823668 podStartE2EDuration="2.918968326s" totalImagesPullingTime="1.622144658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:50.918162118 +0000 UTC m=+100.030357170" watchObservedRunningTime="2026-07-13 19:41:50.918968326 +0000 UTC m=+100.031163378" Jul 13 19:41:51.133472 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.133437 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:51.234562 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.234526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:51.331202 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.331172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:51.399555 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.399520 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:51.796879 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.796797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:51.906091 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.906055 2576 generic.go:356] "Generic (PLEG): container finished" podID="519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0" containerID="e94f5f97cc3abbf73a65c67ddf7b023133dc91318ca1cd064e9d62f5fd1c27b5" exitCode=0 Jul 13 19:41:51.906293 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.906145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdg26" event={"ID":"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0","Type":"ContainerDied","Data":"e94f5f97cc3abbf73a65c67ddf7b023133dc91318ca1cd064e9d62f5fd1c27b5"} Jul 13 19:41:51.907674 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:51.907642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"eb00eaf8c06b8fb081f2a19a90154b7ef3fc4ba079d7bbd8d3d76d0501bf23a5"} Jul 13 19:41:52.079378 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:52.079281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:52.912829 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:52.912792 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9" exitCode=0 Jul 13 19:41:52.913281 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:52.912883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9"} Jul 13 19:41:52.915196 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:52.915172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdg26" event={"ID":"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0","Type":"ContainerStarted","Data":"ae1814ec6d9af6cee157de72b6fb81c43be013646002c3d4b82afde3c53e90d9"} Jul 13 19:41:52.915307 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:52.915216 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdg26" event={"ID":"519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0","Type":"ContainerStarted","Data":"f8a7b06ca77af99c3db8dcac9e6829877c115df2cbb3c99bb07309af9b5fac43"} Jul 13 19:41:52.960765 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:52.960714 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fdg26" podStartSLOduration=3.315966031 podStartE2EDuration="4.96069748s" totalImagesPullingTime="1.565711405s" totalInitContainerRuntime="79.020044ms" isStatefulPod=true podCreationTimestamp="2026-07-13 19:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:52.958724899 +0000 UTC m=+102.070919933" watchObservedRunningTime="2026-07-13 19:41:52.96069748 +0000 UTC m=+102.072892531" Jul 13 19:41:53.174017 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.173931 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4"] Jul 13 19:41:53.177397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.177372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.180478 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.180456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 13 19:41:53.180747 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.180732 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-m5jb8\"" Jul 13 19:41:53.190945 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.190916 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4"] Jul 13 19:41:53.199301 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.199243 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:53.247290 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.247241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppbv6\" (UniqueName: \"kubernetes.io/projected/ad444f74-0d39-4bd2-a59b-91b7379d5f45-kube-api-access-ppbv6\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.247471 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.247361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad444f74-0d39-4bd2-a59b-91b7379d5f45-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.306436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.306404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:53.348645 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.348613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppbv6\" (UniqueName: \"kubernetes.io/projected/ad444f74-0d39-4bd2-a59b-91b7379d5f45-kube-api-access-ppbv6\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.348828 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.348659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad444f74-0d39-4bd2-a59b-91b7379d5f45-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.348828 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:53.348803 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 13 19:41:53.348951 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:41:53.348870 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad444f74-0d39-4bd2-a59b-91b7379d5f45-monitoring-plugin-cert podName:ad444f74-0d39-4bd2-a59b-91b7379d5f45 nodeName:}" failed. No retries permitted until 2026-07-13 19:41:53.848849253 +0000 UTC m=+102.961044283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ad444f74-0d39-4bd2-a59b-91b7379d5f45-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-m4zd4" (UID: "ad444f74-0d39-4bd2-a59b-91b7379d5f45") : secret "monitoring-plugin-cert" not found Jul 13 19:41:53.361411 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.361379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppbv6\" (UniqueName: \"kubernetes.io/projected/ad444f74-0d39-4bd2-a59b-91b7379d5f45-kube-api-access-ppbv6\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.465950 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.465902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:53.854118 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.854029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad444f74-0d39-4bd2-a59b-91b7379d5f45-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:53.856811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:53.856773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad444f74-0d39-4bd2-a59b-91b7379d5f45-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-m4zd4\" (UID: \"ad444f74-0d39-4bd2-a59b-91b7379d5f45\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:54.086515 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.086476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:54.224429 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.224395 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4"] Jul 13 19:41:54.226537 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:54.226504 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad444f74_0d39_4bd2_a59b_91b7379d5f45.slice/crio-399c5ff6aaf4e5b73b7d73d823f219ef29abc4f8950cfc53ed78f1d9542dbd66 WatchSource:0}: Error finding container 399c5ff6aaf4e5b73b7d73d823f219ef29abc4f8950cfc53ed78f1d9542dbd66: Status 404 returned error can't find the container with id 399c5ff6aaf4e5b73b7d73d823f219ef29abc4f8950cfc53ed78f1d9542dbd66 Jul 13 19:41:54.287807 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.287772 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c9b9c4d6-8tvqz"] Jul 13 19:41:54.292327 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.292292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.295963 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.295937 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 19:41:54.296127 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.295940 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 19:41:54.296326 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.296311 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dvl5t\"" Jul 13 19:41:54.296326 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.296322 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 19:41:54.296455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.296327 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 19:41:54.296513 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.296450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 19:41:54.296567 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.296535 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 19:41:54.296622 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.296575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 19:41:54.301212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.301182 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 19:41:54.301901 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.301817 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c9b9c4d6-8tvqz"] Jul 13 19:41:54.360461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-oauth-config\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.360461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-oauth-serving-cert\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.360676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-config\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.360676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd2vn\" (UniqueName: \"kubernetes.io/projected/5147c3c6-eefc-4baa-9884-b7e29c36e125-kube-api-access-qd2vn\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.360676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-service-ca\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.360676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-serving-cert\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.360811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.360696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-trusted-ca-bundle\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462127 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-serving-cert\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-trusted-ca-bundle\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-oauth-config\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-oauth-serving-cert\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-config\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd2vn\" (UniqueName: \"kubernetes.io/projected/5147c3c6-eefc-4baa-9884-b7e29c36e125-kube-api-access-qd2vn\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.462611 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.462421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-service-ca\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.463169 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.463083 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-config\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.463169 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.463098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-service-ca\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.463376 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.463281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-oauth-serving-cert\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.463376 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.463334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-trusted-ca-bundle\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.464827 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.464804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-oauth-config\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.464945 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.464929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-serving-cert\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.471940 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.471915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd2vn\" (UniqueName: \"kubernetes.io/projected/5147c3c6-eefc-4baa-9884-b7e29c36e125-kube-api-access-qd2vn\") pod \"console-66c9b9c4d6-8tvqz\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.604643 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.604608 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:41:54.604988 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.604956 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:54.759373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.759344 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c9b9c4d6-8tvqz"] Jul 13 19:41:54.762342 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:41:54.762315 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5147c3c6_eefc_4baa_9884_b7e29c36e125.slice/crio-70deaff1ce319682374dc1b34e32a2775adf9edbe3e7a855e2b7c7139bf9e5b9 WatchSource:0}: Error finding container 70deaff1ce319682374dc1b34e32a2775adf9edbe3e7a855e2b7c7139bf9e5b9: Status 404 returned error can't find the container with id 70deaff1ce319682374dc1b34e32a2775adf9edbe3e7a855e2b7c7139bf9e5b9 Jul 13 19:41:54.925085 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.925041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" event={"ID":"ad444f74-0d39-4bd2-a59b-91b7379d5f45","Type":"ContainerStarted","Data":"399c5ff6aaf4e5b73b7d73d823f219ef29abc4f8950cfc53ed78f1d9542dbd66"} Jul 13 19:41:54.926545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:54.926511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9b9c4d6-8tvqz" event={"ID":"5147c3c6-eefc-4baa-9884-b7e29c36e125","Type":"ContainerStarted","Data":"70deaff1ce319682374dc1b34e32a2775adf9edbe3e7a855e2b7c7139bf9e5b9"} Jul 13 19:41:56.939479 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:56.939437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75"} Jul 13 19:41:56.939929 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:56.939572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce"} Jul 13 19:41:56.941275 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:56.941197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" event={"ID":"ad444f74-0d39-4bd2-a59b-91b7379d5f45","Type":"ContainerStarted","Data":"977755c786c7875cabf74680bb7c0d28053e5661647880030a7082ab002bec99"} Jul 13 19:41:56.960102 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:56.960044 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" podStartSLOduration=1.44075715 podStartE2EDuration="3.960023259s" totalImagesPullingTime="2.519266109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:56.959106841 +0000 UTC m=+106.071301893" watchObservedRunningTime="2026-07-13 19:41:56.960023259 +0000 UTC m=+106.072218303" Jul 13 19:41:57.946306 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:57.946277 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:57.951808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:57.951776 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-m4zd4" Jul 13 19:41:58.915944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.915904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:58.952620 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.952585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9b9c4d6-8tvqz" event={"ID":"5147c3c6-eefc-4baa-9884-b7e29c36e125","Type":"ContainerStarted","Data":"e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32"} Jul 13 19:41:58.955912 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.955879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6"} Jul 13 19:41:58.956054 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.955977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce"} Jul 13 19:41:58.956054 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.956007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9"} Jul 13 19:41:58.972120 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.972064 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c9b9c4d6-8tvqz" podStartSLOduration=1.279925959 podStartE2EDuration="4.972045552s" totalImagesPullingTime="3.692119593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:41:58.971211702 +0000 UTC m=+108.083406752" watchObservedRunningTime="2026-07-13 19:41:58.972045552 +0000 UTC m=+108.084240604" Jul 13 19:41:58.975812 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:58.975772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:59.834559 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:41:59.834516 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c9b9c4d6-8tvqz"] Jul 13 19:42:00.969287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:00.969223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerStarted","Data":"268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974"} Jul 13 19:42:01.001000 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:01.000940 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.322674236 podStartE2EDuration="12.000922095s" totalImagesPullingTime="6.66209325s" totalInitContainerRuntime="16.154609ms" isStatefulPod=false podCreationTimestamp="2026-07-13 19:41:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:42:00.998344752 +0000 UTC m=+110.110539803" watchObservedRunningTime="2026-07-13 19:42:01.000922095 +0000 UTC m=+110.113117145" Jul 13 19:42:04.605040 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:04.604992 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:42:09.897751 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:09.897709 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" podUID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" containerName="registry" containerID="cri-o://8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e" gracePeriod=30 Jul 13 19:42:10.148560 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.148493 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:42:10.317241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317191 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-image-registry-private-configuration\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317274 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-certificates\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317480 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317304 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-installation-pull-secrets\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317515 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317469 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfb2v\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-kube-api-access-tfb2v\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317550 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-trusted-ca\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317550 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317540 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-bound-sa-token\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317632 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.317632 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.317611 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-ca-trust-extracted\") pod \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\" (UID: \"05088faf-7bfc-4cf1-91e1-7beb9091bd9d\") " Jul 13 19:42:10.318280 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.318203 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:42:10.318585 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.318337 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:42:10.321283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.320904 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:42:10.321283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.321011 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-kube-api-access-tfb2v" (OuterVolumeSpecName: "kube-api-access-tfb2v") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "kube-api-access-tfb2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:42:10.321469 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.321383 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:42:10.321676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.321647 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:42:10.326276 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.326112 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:42:10.329513 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.329483 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "05088faf-7bfc-4cf1-91e1-7beb9091bd9d" (UID: "05088faf-7bfc-4cf1-91e1-7beb9091bd9d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419235 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-image-registry-private-configuration\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419282 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-certificates\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419292 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-installation-pull-secrets\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419301 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfb2v\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-kube-api-access-tfb2v\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419309 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-trusted-ca\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419317 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-bound-sa-token\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419324 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-registry-tls\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:10.419336 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:10.419331 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05088faf-7bfc-4cf1-91e1-7beb9091bd9d-ca-trust-extracted\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:11.009858 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.009823 2576 generic.go:356] "Generic (PLEG): container finished" podID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" containerID="8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e" exitCode=0 Jul 13 19:42:11.010322 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.009878 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" Jul 13 19:42:11.010322 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.009909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" event={"ID":"05088faf-7bfc-4cf1-91e1-7beb9091bd9d","Type":"ContainerDied","Data":"8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e"} Jul 13 19:42:11.010322 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.009960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f745b49f5-c6slk" event={"ID":"05088faf-7bfc-4cf1-91e1-7beb9091bd9d","Type":"ContainerDied","Data":"5fd65d56df9e5e79caca4a628b2d9ed3849ce1c555be1fe0ac5bbd10ca320eb9"} Jul 13 19:42:11.010322 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.009981 2576 scope.go:117] "RemoveContainer" containerID="8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e" Jul 13 19:42:11.018637 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.018619 2576 scope.go:117] "RemoveContainer" containerID="8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e" Jul 13 19:42:11.018928 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:42:11.018909 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e\": container with ID starting with 8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e not found: ID does not exist" containerID="8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e" Jul 13 19:42:11.018981 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.018936 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e"} err="failed to get container status \"8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e\": rpc error: code = NotFound desc = could not find container \"8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e\": container with ID starting with 8da2121df11fa744ab2da96e8f5ab60cdeea1d480275133483f6e64940b76a2e not found: ID does not exist" Jul 13 19:42:11.030706 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.030678 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f745b49f5-c6slk"] Jul 13 19:42:11.035369 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.035343 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f745b49f5-c6slk"] Jul 13 19:42:11.316800 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.316722 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:11.380305 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.380269 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" path="/var/lib/kubelet/pods/05088faf-7bfc-4cf1-91e1-7beb9091bd9d/volumes" Jul 13 19:42:11.419814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.419772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:11.520458 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:11.520419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:13.021406 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:13.021367 2576 generic.go:356] "Generic (PLEG): container finished" podID="e08f6c3e-9242-4765-9c14-f43ae23d6ae8" containerID="2143b264963d75beaafe2489e5b9d55eed7b26d3bd5ee2fa85878c6a14805e37" exitCode=0 Jul 13 19:42:13.021853 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:13.021443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" event={"ID":"e08f6c3e-9242-4765-9c14-f43ae23d6ae8","Type":"ContainerDied","Data":"2143b264963d75beaafe2489e5b9d55eed7b26d3bd5ee2fa85878c6a14805e37"} Jul 13 19:42:13.021899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:13.021857 2576 scope.go:117] "RemoveContainer" containerID="2143b264963d75beaafe2489e5b9d55eed7b26d3bd5ee2fa85878c6a14805e37" Jul 13 19:42:14.028753 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:14.028720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rvr4q" event={"ID":"e08f6c3e-9242-4765-9c14-f43ae23d6ae8","Type":"ContainerStarted","Data":"b34e9780f24b05d469704634c5a5ccb90d8dd7dc7e1d79d54ac2dbe334d39bb7"} Jul 13 19:42:14.082573 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:14.082538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:14.184727 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:14.184682 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:14.284120 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:14.284031 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:19.031964 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:19.031922 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:21.351883 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:21.351847 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:21.404517 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:21.404484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:23.063720 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:23.063685 2576 generic.go:356] "Generic (PLEG): container finished" podID="9af902ac-ee33-4f13-a579-a80fa4bc0ffa" containerID="a28de12378e2f0643f7d1ceaa092b3c703b616e5f76a22f2de707262ed40f3a2" exitCode=0 Jul 13 19:42:23.064090 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:23.063743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" event={"ID":"9af902ac-ee33-4f13-a579-a80fa4bc0ffa","Type":"ContainerDied","Data":"a28de12378e2f0643f7d1ceaa092b3c703b616e5f76a22f2de707262ed40f3a2"} Jul 13 19:42:23.064142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:23.064094 2576 scope.go:117] "RemoveContainer" containerID="a28de12378e2f0643f7d1ceaa092b3c703b616e5f76a22f2de707262ed40f3a2" Jul 13 19:42:24.069849 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:24.069816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4l9gh" event={"ID":"9af902ac-ee33-4f13-a579-a80fa4bc0ffa","Type":"ContainerStarted","Data":"6d122e474499c8df1aad1564f8c50f14e81b0f049a587f93254da5ea69e66143"} Jul 13 19:42:25.990034 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:25.989991 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c9b9c4d6-8tvqz" podUID="5147c3c6-eefc-4baa-9884-b7e29c36e125" containerName="console" containerID="cri-o://e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32" gracePeriod=15 Jul 13 19:42:26.241510 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.241449 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:42:26.339862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.339821 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-serving-cert\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.339875 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-oauth-serving-cert\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.339905 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd2vn\" (UniqueName: \"kubernetes.io/projected/5147c3c6-eefc-4baa-9884-b7e29c36e125-kube-api-access-qd2vn\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.339931 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-config\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.339950 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-service-ca\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.339976 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-oauth-config\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.340016 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-trusted-ca-bundle\") pod \"5147c3c6-eefc-4baa-9884-b7e29c36e125\" (UID: \"5147c3c6-eefc-4baa-9884-b7e29c36e125\") " Jul 13 19:42:26.340600 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.340514 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-config" (OuterVolumeSpecName: "console-config") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:42:26.340600 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.340581 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-service-ca" (OuterVolumeSpecName: "service-ca") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:42:26.340776 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.340672 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:42:26.340846 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.340703 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:42:26.342376 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.342332 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:42:26.342462 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.342420 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5147c3c6-eefc-4baa-9884-b7e29c36e125-kube-api-access-qd2vn" (OuterVolumeSpecName: "kube-api-access-qd2vn") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "kube-api-access-qd2vn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:42:26.342519 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.342500 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5147c3c6-eefc-4baa-9884-b7e29c36e125" (UID: "5147c3c6-eefc-4baa-9884-b7e29c36e125"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:42:26.440841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440798 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-oauth-serving-cert\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:26.440841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440833 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd2vn\" (UniqueName: \"kubernetes.io/projected/5147c3c6-eefc-4baa-9884-b7e29c36e125-kube-api-access-qd2vn\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:26.440841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440843 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-config\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:26.440841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440852 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-service-ca\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:26.441101 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440860 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-oauth-config\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:26.441101 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440870 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5147c3c6-eefc-4baa-9884-b7e29c36e125-trusted-ca-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:26.441101 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:26.440882 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5147c3c6-eefc-4baa-9884-b7e29c36e125-console-serving-cert\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:42:27.081848 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.081810 2576 generic.go:356] "Generic (PLEG): container finished" podID="5147c3c6-eefc-4baa-9884-b7e29c36e125" containerID="e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32" exitCode=0 Jul 13 19:42:27.082241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.081883 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9b9c4d6-8tvqz" Jul 13 19:42:27.082241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.081897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9b9c4d6-8tvqz" event={"ID":"5147c3c6-eefc-4baa-9884-b7e29c36e125","Type":"ContainerDied","Data":"e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32"} Jul 13 19:42:27.082241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.081980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9b9c4d6-8tvqz" event={"ID":"5147c3c6-eefc-4baa-9884-b7e29c36e125","Type":"ContainerDied","Data":"70deaff1ce319682374dc1b34e32a2775adf9edbe3e7a855e2b7c7139bf9e5b9"} Jul 13 19:42:27.082241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.082002 2576 scope.go:117] "RemoveContainer" containerID="e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32" Jul 13 19:42:27.090752 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.090734 2576 scope.go:117] "RemoveContainer" containerID="e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32" Jul 13 19:42:27.091043 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:42:27.091024 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32\": container with ID starting with e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32 not found: ID does not exist" containerID="e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32" Jul 13 19:42:27.091097 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.091052 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32"} err="failed to get container status \"e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32\": rpc error: code = NotFound desc = could not find container \"e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32\": container with ID starting with e8136e2182962d4a0b87a7bb6ced522444f835a2e4c1e78ac8181ae29b79ff32 not found: ID does not exist" Jul 13 19:42:27.103297 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.103264 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c9b9c4d6-8tvqz"] Jul 13 19:42:27.108991 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.108967 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c9b9c4d6-8tvqz"] Jul 13 19:42:27.378853 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.378764 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5147c3c6-eefc-4baa-9884-b7e29c36e125" path="/var/lib/kubelet/pods/5147c3c6-eefc-4baa-9884-b7e29c36e125/volumes" Jul 13 19:42:27.423921 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:27.423893 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:34.111496 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:34.111464 2576 generic.go:356] "Generic (PLEG): container finished" podID="7af54ba5-4deb-4fe4-91a7-8a89474402ea" containerID="f44f4e8a1fc88fe60f5b6b6c7e319979d8f08505cb94a5b237284e1fc7ee7fa2" exitCode=0 Jul 13 19:42:34.111926 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:34.111507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" event={"ID":"7af54ba5-4deb-4fe4-91a7-8a89474402ea","Type":"ContainerDied","Data":"f44f4e8a1fc88fe60f5b6b6c7e319979d8f08505cb94a5b237284e1fc7ee7fa2"} Jul 13 19:42:34.111926 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:34.111875 2576 scope.go:117] "RemoveContainer" containerID="f44f4e8a1fc88fe60f5b6b6c7e319979d8f08505cb94a5b237284e1fc7ee7fa2" Jul 13 19:42:35.119712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:35.119675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-t294p" event={"ID":"7af54ba5-4deb-4fe4-91a7-8a89474402ea","Type":"ContainerStarted","Data":"4453415da7abedc1166332d87e73d9bd110cc4d72607599d1735e4a64bf6899d"} Jul 13 19:42:37.241224 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:42:37.241184 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:04.471101 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:04.470995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:04.535107 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:04.535066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:07.903140 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:07.903105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:08.720482 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720448 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:43:08.720800 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720757 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="alertmanager" containerID="cri-o://582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce" gracePeriod=120 Jul 13 19:43:08.720876 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720840 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-web" containerID="cri-o://5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9" gracePeriod=120 Jul 13 19:43:08.720944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720881 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="prom-label-proxy" containerID="cri-o://268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974" gracePeriod=120 Jul 13 19:43:08.720944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720894 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy" containerID="cri-o://a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce" gracePeriod=120 Jul 13 19:43:08.721053 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720930 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="config-reloader" containerID="cri-o://5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75" gracePeriod=120 Jul 13 19:43:08.721053 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:08.720829 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-metric" containerID="cri-o://452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6" gracePeriod=120 Jul 13 19:43:09.263809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263770 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974" exitCode=0 Jul 13 19:43:09.263809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263800 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6" exitCode=0 Jul 13 19:43:09.263809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263810 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce" exitCode=0 Jul 13 19:43:09.263809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263816 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75" exitCode=0 Jul 13 19:43:09.264373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263824 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce" exitCode=0 Jul 13 19:43:09.264373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974"} Jul 13 19:43:09.264373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6"} Jul 13 19:43:09.264373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce"} Jul 13 19:43:09.264373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75"} Jul 13 19:43:09.264373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.263985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce"} Jul 13 19:43:09.977169 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:09.977142 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.006622 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006586 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.006802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006634 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.006802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006654 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-volume\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.006802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006672 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-main-db\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.006802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006690 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-main-tls\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.006802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006714 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.006802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006743 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-cluster-tls-config\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006860 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-metrics-client-ca\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006940 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-out\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.006974 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrk6q\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-kube-api-access-vrk6q\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-tls-assets\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007056 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-web-config\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007082 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\" (UID: \"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8\") " Jul 13 19:43:10.007119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007111 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:43:10.007705 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007371 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.007705 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007383 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:43:10.007960 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.007928 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:43:10.009760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.009735 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.010529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.010467 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.010529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.010492 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-volume" (OuterVolumeSpecName: "config-volume") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.010849 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.010812 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-kube-api-access-vrk6q" (OuterVolumeSpecName: "kube-api-access-vrk6q") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "kube-api-access-vrk6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:43:10.011059 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.011034 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-out" (OuterVolumeSpecName: "config-out") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:43:10.011059 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.011045 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.011381 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.011337 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.011770 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.011748 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:43:10.016891 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.016855 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.024819 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.024784 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-web-config" (OuterVolumeSpecName: "web-config") pod "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" (UID: "1382af70-8e7a-4c75-bd1f-0ef7d03cacf8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108297 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108344 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-volume\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108356 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-alertmanager-main-db\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108366 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-main-tls\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108375 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108383 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-cluster-tls-config\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108393 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-metrics-client-ca\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108400 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-config-out\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108408 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrk6q\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-kube-api-access-vrk6q\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108416 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-tls-assets\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108810 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108425 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-web-config\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.108810 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.108432 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:43:10.270808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.270770 2576 generic.go:356] "Generic (PLEG): container finished" podID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerID="5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9" exitCode=0 Jul 13 19:43:10.271287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.270831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9"} Jul 13 19:43:10.271287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.270847 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.271287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.270891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1382af70-8e7a-4c75-bd1f-0ef7d03cacf8","Type":"ContainerDied","Data":"eb00eaf8c06b8fb081f2a19a90154b7ef3fc4ba079d7bbd8d3d76d0501bf23a5"} Jul 13 19:43:10.271287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.270923 2576 scope.go:117] "RemoveContainer" containerID="268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974" Jul 13 19:43:10.279333 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.279310 2576 scope.go:117] "RemoveContainer" containerID="452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6" Jul 13 19:43:10.286688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.286671 2576 scope.go:117] "RemoveContainer" containerID="a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce" Jul 13 19:43:10.294167 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.294145 2576 scope.go:117] "RemoveContainer" containerID="5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9" Jul 13 19:43:10.298545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.298511 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:43:10.301381 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.301358 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:43:10.302655 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.302634 2576 scope.go:117] "RemoveContainer" containerID="5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75" Jul 13 19:43:10.310224 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.310202 2576 scope.go:117] "RemoveContainer" containerID="582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce" Jul 13 19:43:10.317890 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.317870 2576 scope.go:117] "RemoveContainer" containerID="966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9" Jul 13 19:43:10.325436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.325415 2576 scope.go:117] "RemoveContainer" containerID="268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974" Jul 13 19:43:10.325717 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.325696 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974\": container with ID starting with 268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974 not found: ID does not exist" containerID="268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974" Jul 13 19:43:10.325764 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.325728 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974"} err="failed to get container status \"268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974\": rpc error: code = NotFound desc = could not find container \"268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974\": container with ID starting with 268377bafa692c1867ee89ed6d2825b9f085df84d0046a45c582aabb8bdca974 not found: ID does not exist" Jul 13 19:43:10.325764 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.325750 2576 scope.go:117] "RemoveContainer" containerID="452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6" Jul 13 19:43:10.325995 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.325976 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6\": container with ID starting with 452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6 not found: ID does not exist" containerID="452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6" Jul 13 19:43:10.326032 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326001 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6"} err="failed to get container status \"452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6\": rpc error: code = NotFound desc = could not find container \"452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6\": container with ID starting with 452f2f4ec4092aea68902f91508012365f75f16d6e16c05259cfe861bf18cfc6 not found: ID does not exist" Jul 13 19:43:10.326032 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326020 2576 scope.go:117] "RemoveContainer" containerID="a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce" Jul 13 19:43:10.326294 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.326274 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce\": container with ID starting with a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce not found: ID does not exist" containerID="a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce" Jul 13 19:43:10.326346 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326303 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce"} err="failed to get container status \"a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce\": rpc error: code = NotFound desc = could not find container \"a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce\": container with ID starting with a7b650733c117bfd9aa86b35fe9e32d0a5ca69d5be3eac4af9feb7dd171b72ce not found: ID does not exist" Jul 13 19:43:10.326346 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326322 2576 scope.go:117] "RemoveContainer" containerID="5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9" Jul 13 19:43:10.326578 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.326560 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9\": container with ID starting with 5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9 not found: ID does not exist" containerID="5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9" Jul 13 19:43:10.326618 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326582 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9"} err="failed to get container status \"5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9\": rpc error: code = NotFound desc = could not find container \"5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9\": container with ID starting with 5270a9f40ea6044922c66d1cec8eb821cee58987d1a6aef6a872b1fd9463efd9 not found: ID does not exist" Jul 13 19:43:10.326618 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326597 2576 scope.go:117] "RemoveContainer" containerID="5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75" Jul 13 19:43:10.326836 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.326819 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75\": container with ID starting with 5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75 not found: ID does not exist" containerID="5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75" Jul 13 19:43:10.326869 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326842 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75"} err="failed to get container status \"5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75\": rpc error: code = NotFound desc = could not find container \"5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75\": container with ID starting with 5fa349a0b173d1350eb2f09ae6a3b23733c88b53b711dafae0aa2b0b237dcd75 not found: ID does not exist" Jul 13 19:43:10.326869 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.326856 2576 scope.go:117] "RemoveContainer" containerID="582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce" Jul 13 19:43:10.327061 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.327045 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce\": container with ID starting with 582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce not found: ID does not exist" containerID="582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce" Jul 13 19:43:10.327100 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.327066 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce"} err="failed to get container status \"582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce\": rpc error: code = NotFound desc = could not find container \"582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce\": container with ID starting with 582cfea71178010f291ff8d18fbda6fad5c406cb1ed386b125c648c5f89c0fce not found: ID does not exist" Jul 13 19:43:10.327100 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.327082 2576 scope.go:117] "RemoveContainer" containerID="966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9" Jul 13 19:43:10.327321 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:43:10.327304 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9\": container with ID starting with 966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9 not found: ID does not exist" containerID="966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9" Jul 13 19:43:10.327373 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.327325 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9"} err="failed to get container status \"966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9\": rpc error: code = NotFound desc = could not find container \"966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9\": container with ID starting with 966568ffaa5294b9f40cddf44de79eb5e5175454ff2317949b553dfe03c23cf9 not found: ID does not exist" Jul 13 19:43:10.341624 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341594 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:43:10.341888 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341876 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="init-config-reloader" Jul 13 19:43:10.341928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341890 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="init-config-reloader" Jul 13 19:43:10.341928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341900 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="prom-label-proxy" Jul 13 19:43:10.341928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341906 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="prom-label-proxy" Jul 13 19:43:10.341928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341913 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5147c3c6-eefc-4baa-9884-b7e29c36e125" containerName="console" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341934 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5147c3c6-eefc-4baa-9884-b7e29c36e125" containerName="console" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341943 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" containerName="registry" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341948 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" containerName="registry" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341954 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="alertmanager" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341961 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="alertmanager" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341971 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-metric" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341976 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-metric" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341984 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="config-reloader" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341989 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="config-reloader" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.341996 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-web" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342001 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-web" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342010 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy" Jul 13 19:43:10.342035 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342014 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342062 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="prom-label-proxy" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342071 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342078 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05088faf-7bfc-4cf1-91e1-7beb9091bd9d" containerName="registry" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342084 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="alertmanager" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342091 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-web" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342097 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5147c3c6-eefc-4baa-9884-b7e29c36e125" containerName="console" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342103 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="kube-rbac-proxy-metric" Jul 13 19:43:10.342403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.342109 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" containerName="config-reloader" Jul 13 19:43:10.346945 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.346925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.349679 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.349644 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 19:43:10.349797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.349644 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 19:43:10.349797 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.349719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 19:43:10.350309 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.350293 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 19:43:10.350458 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.350443 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 19:43:10.350658 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.350644 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 19:43:10.350848 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.350836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 19:43:10.350915 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.350900 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 19:43:10.352359 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.352328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ddmwc\"" Jul 13 19:43:10.358057 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.358033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 19:43:10.368461 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.368397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:43:10.410628 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8129d6b3-913e-4d01-822a-6ac1fda65c1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8129d6b3-913e-4d01-822a-6ac1fda65c1d-config-out\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9lp\" (UniqueName: \"kubernetes.io/projected/8129d6b3-913e-4d01-822a-6ac1fda65c1d-kube-api-access-2b9lp\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-web-config\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.410809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.411028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8129d6b3-913e-4d01-822a-6ac1fda65c1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.411028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.411028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8129d6b3-913e-4d01-822a-6ac1fda65c1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.411028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.411028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.410920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8129d6b3-913e-4d01-822a-6ac1fda65c1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.511751 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8129d6b3-913e-4d01-822a-6ac1fda65c1d-config-out\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.511751 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9lp\" (UniqueName: \"kubernetes.io/projected/8129d6b3-913e-4d01-822a-6ac1fda65c1d-kube-api-access-2b9lp\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-web-config\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8129d6b3-913e-4d01-822a-6ac1fda65c1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8129d6b3-913e-4d01-822a-6ac1fda65c1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.511978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8129d6b3-913e-4d01-822a-6ac1fda65c1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512471 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.512018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512471 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.512042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8129d6b3-913e-4d01-822a-6ac1fda65c1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512471 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.512415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8129d6b3-913e-4d01-822a-6ac1fda65c1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.512947 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.512911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8129d6b3-913e-4d01-822a-6ac1fda65c1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.514870 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.514838 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8129d6b3-913e-4d01-822a-6ac1fda65c1d-config-out\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515001 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.514971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515075 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515041 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515159 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515136 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-web-config\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515428 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8129d6b3-913e-4d01-822a-6ac1fda65c1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515686 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8129d6b3-913e-4d01-822a-6ac1fda65c1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515735 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.515865 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.515845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.517075 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.517059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8129d6b3-913e-4d01-822a-6ac1fda65c1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.521059 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.521038 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9lp\" (UniqueName: \"kubernetes.io/projected/8129d6b3-913e-4d01-822a-6ac1fda65c1d-kube-api-access-2b9lp\") pod \"alertmanager-main-0\" (UID: \"8129d6b3-913e-4d01-822a-6ac1fda65c1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.656700 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.656616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 19:43:10.827589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:10.827553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 19:43:10.830749 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:43:10.830713 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8129d6b3_913e_4d01_822a_6ac1fda65c1d.slice/crio-f6713bc4e41076b50b1afe1ccc585dd3ff8285ae84881ba44078f130ca6a9ef6 WatchSource:0}: Error finding container f6713bc4e41076b50b1afe1ccc585dd3ff8285ae84881ba44078f130ca6a9ef6: Status 404 returned error can't find the container with id f6713bc4e41076b50b1afe1ccc585dd3ff8285ae84881ba44078f130ca6a9ef6 Jul 13 19:43:11.276932 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:11.276893 2576 generic.go:356] "Generic (PLEG): container finished" podID="8129d6b3-913e-4d01-822a-6ac1fda65c1d" containerID="78b1e69cddbc36305e693334e6025371fc438921bd8e34181e3e8996cdff4ed6" exitCode=0 Jul 13 19:43:11.277415 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:11.276977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerDied","Data":"78b1e69cddbc36305e693334e6025371fc438921bd8e34181e3e8996cdff4ed6"} Jul 13 19:43:11.277415 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:11.277077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"f6713bc4e41076b50b1afe1ccc585dd3ff8285ae84881ba44078f130ca6a9ef6"} Jul 13 19:43:11.381643 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:11.381614 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1382af70-8e7a-4c75-bd1f-0ef7d03cacf8" path="/var/lib/kubelet/pods/1382af70-8e7a-4c75-bd1f-0ef7d03cacf8/volumes" Jul 13 19:43:12.284325 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.284288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"cdb7eb34b814fca7b658ddcae0cc8fa08f1796d6d27b946a1adccfc1a84b2ad5"} Jul 13 19:43:12.284712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.284389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"cc19e1000c2febe1eb78cbf25041c35a79aa5d019e59c58c41fc7cc2100b53c9"} Jul 13 19:43:12.284712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.284419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"301ea0685b17dd9b22e65ad01bfbc01cdd9206f1108468565afd4fdfab750c06"} Jul 13 19:43:12.284712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.284444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"3ec2be143bc1f1b42180d7ec9b73498774d4558cd6e6248546cb4b760f19fb2a"} Jul 13 19:43:12.284712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.284472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"290ee092e6bf3c9da49455994f92d67a638c86ebbb9051df9163f84f2f8682d9"} Jul 13 19:43:12.284712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.284496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8129d6b3-913e-4d01-822a-6ac1fda65c1d","Type":"ContainerStarted","Data":"9158d076b4e0c30564da7157c999afab8fb00afb678a3b37d78153f4f2cf65b5"} Jul 13 19:43:12.311692 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:12.311633 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.291899634 podStartE2EDuration="2.311617314s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.71768ms" isStatefulPod=false podCreationTimestamp="2026-07-13 19:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:43:12.309885851 +0000 UTC m=+181.422080904" watchObservedRunningTime="2026-07-13 19:43:12.311617314 +0000 UTC m=+181.423812365" Jul 13 19:43:16.288396 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:16.288352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:16.389627 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:16.389591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:18.876379 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.876344 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7bbfb5d5-v77zs"] Jul 13 19:43:18.880942 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.880915 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.883544 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.883515 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 19:43:18.883544 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.883539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 19:43:18.883756 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.883513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 19:43:18.884453 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.884431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 19:43:18.884583 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.884478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 19:43:18.884583 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.884550 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 19:43:18.884772 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.884739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dvl5t\"" Jul 13 19:43:18.884877 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.884797 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 19:43:18.889355 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.889303 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 19:43:18.894219 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.894193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7bbfb5d5-v77zs"] Jul 13 19:43:18.927308 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.927271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:18.979619 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-serving-cert\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.979811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-trusted-ca-bundle\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.979811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-oauth-config\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.979811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-oauth-serving-cert\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.979811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-service-ca\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.979811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-config\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.979811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.979786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5978r\" (UniqueName: \"kubernetes.io/projected/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-kube-api-access-5978r\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:18.980814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:18.980784 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:19.080221 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-serving-cert\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.080221 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-trusted-ca-bundle\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.080462 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-oauth-config\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.080462 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-oauth-serving-cert\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.080578 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-service-ca\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.080624 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-config\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.080676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.080658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5978r\" (UniqueName: \"kubernetes.io/projected/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-kube-api-access-5978r\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.081266 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.081215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-trusted-ca-bundle\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.081391 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.081331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-service-ca\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.081391 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.081356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-config\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.081391 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.081365 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-oauth-serving-cert\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.082977 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.082957 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-serving-cert\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.083083 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.082962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-oauth-config\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.089445 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.089424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5978r\" (UniqueName: \"kubernetes.io/projected/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-kube-api-access-5978r\") pod \"console-7b7bbfb5d5-v77zs\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.192764 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.192672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:19.331123 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:19.331086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7bbfb5d5-v77zs"] Jul 13 19:43:19.334426 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:43:19.334395 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891f2f50_3555_41ae_bf5e_4c2730eb9cbe.slice/crio-15fac48383973e920165c43716c024cefaafd9401b5bb8014c92c9b4ddae0857 WatchSource:0}: Error finding container 15fac48383973e920165c43716c024cefaafd9401b5bb8014c92c9b4ddae0857: Status 404 returned error can't find the container with id 15fac48383973e920165c43716c024cefaafd9401b5bb8014c92c9b4ddae0857 Jul 13 19:43:20.320475 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:20.320434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7bbfb5d5-v77zs" event={"ID":"891f2f50-3555-41ae-bf5e-4c2730eb9cbe","Type":"ContainerStarted","Data":"aefa97b3c74fa3d80a93b3529312e61168f9650cf063f540998eeb9f3f417945"} Jul 13 19:43:20.320937 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:20.320495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7bbfb5d5-v77zs" event={"ID":"891f2f50-3555-41ae-bf5e-4c2730eb9cbe","Type":"ContainerStarted","Data":"15fac48383973e920165c43716c024cefaafd9401b5bb8014c92c9b4ddae0857"} Jul 13 19:43:20.339630 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:20.339558 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b7bbfb5d5-v77zs" podStartSLOduration=2.339543763 podStartE2EDuration="2.339543763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:43:20.338328098 +0000 UTC m=+189.450523148" watchObservedRunningTime="2026-07-13 19:43:20.339543763 +0000 UTC m=+189.451738814" Jul 13 19:43:21.385933 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:21.385901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:21.482424 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:21.482389 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:29.193429 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.193383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:29.193870 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.193455 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:29.198362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.198337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:29.363290 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.363260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:43:29.509080 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.509039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:29.572509 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.572466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:29.627804 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:43:29.627762 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:06.671543 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:06.671506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:06.876973 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:06.876925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:07.363092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.363060 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr"] Jul 13 19:44:07.366437 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.366421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.369354 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.369331 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 19:44:07.369493 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.369331 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 19:44:07.370154 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.370141 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h9z9\"" Jul 13 19:44:07.379638 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.379615 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr"] Jul 13 19:44:07.400751 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.400718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgldf\" (UniqueName: \"kubernetes.io/projected/fb4cf507-c34f-46e8-b2fb-60ee96cac357-kube-api-access-fgldf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.400907 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.400755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.400907 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.400875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.501556 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.501486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.501754 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.501620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.501754 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.501661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgldf\" (UniqueName: \"kubernetes.io/projected/fb4cf507-c34f-46e8-b2fb-60ee96cac357-kube-api-access-fgldf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.501933 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.501912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.501988 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.501944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.510777 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.510749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgldf\" (UniqueName: \"kubernetes.io/projected/fb4cf507-c34f-46e8-b2fb-60ee96cac357-kube-api-access-fgldf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.676758 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.676670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:07.810723 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:07.810601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr"] Jul 13 19:44:07.813006 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:44:07.812978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4cf507_c34f_46e8_b2fb_60ee96cac357.slice/crio-2cffc9d07594f5f42c410ac1a06cfd4992436e9d1d6a2058ee4db3fe39f3a262 WatchSource:0}: Error finding container 2cffc9d07594f5f42c410ac1a06cfd4992436e9d1d6a2058ee4db3fe39f3a262: Status 404 returned error can't find the container with id 2cffc9d07594f5f42c410ac1a06cfd4992436e9d1d6a2058ee4db3fe39f3a262 Jul 13 19:44:08.511028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:08.510989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" event={"ID":"fb4cf507-c34f-46e8-b2fb-60ee96cac357","Type":"ContainerStarted","Data":"2cffc9d07594f5f42c410ac1a06cfd4992436e9d1d6a2058ee4db3fe39f3a262"} Jul 13 19:44:15.541812 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:15.541772 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerID="15d3e25bd657f9643f9e646a0f18a496a116546b98ea0a0f4490179e8faf30f6" exitCode=0 Jul 13 19:44:15.542243 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:15.541865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" event={"ID":"fb4cf507-c34f-46e8-b2fb-60ee96cac357","Type":"ContainerDied","Data":"15d3e25bd657f9643f9e646a0f18a496a116546b98ea0a0f4490179e8faf30f6"} Jul 13 19:44:18.557319 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:18.557289 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerID="0e632f1cbc12060d57718c6922c226e0d51e3ce7881f88292875da54dae82c61" exitCode=0 Jul 13 19:44:18.557699 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:18.557365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" event={"ID":"fb4cf507-c34f-46e8-b2fb-60ee96cac357","Type":"ContainerDied","Data":"0e632f1cbc12060d57718c6922c226e0d51e3ce7881f88292875da54dae82c61"} Jul 13 19:44:27.600955 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:27.600922 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerID="c8651967982685fe6fc5f11384a5ec507dc3ffc71ea107627c829375314dbdf1" exitCode=0 Jul 13 19:44:27.601356 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:27.601007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" event={"ID":"fb4cf507-c34f-46e8-b2fb-60ee96cac357","Type":"ContainerDied","Data":"c8651967982685fe6fc5f11384a5ec507dc3ffc71ea107627c829375314dbdf1"} Jul 13 19:44:28.778154 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.778122 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:28.891968 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.891889 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-bundle\") pod \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " Jul 13 19:44:28.892121 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.891980 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgldf\" (UniqueName: \"kubernetes.io/projected/fb4cf507-c34f-46e8-b2fb-60ee96cac357-kube-api-access-fgldf\") pod \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " Jul 13 19:44:28.892121 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.892003 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-util\") pod \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\" (UID: \"fb4cf507-c34f-46e8-b2fb-60ee96cac357\") " Jul 13 19:44:28.892681 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.892651 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-bundle" (OuterVolumeSpecName: "bundle") pod "fb4cf507-c34f-46e8-b2fb-60ee96cac357" (UID: "fb4cf507-c34f-46e8-b2fb-60ee96cac357"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:44:28.894304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.894272 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4cf507-c34f-46e8-b2fb-60ee96cac357-kube-api-access-fgldf" (OuterVolumeSpecName: "kube-api-access-fgldf") pod "fb4cf507-c34f-46e8-b2fb-60ee96cac357" (UID: "fb4cf507-c34f-46e8-b2fb-60ee96cac357"). InnerVolumeSpecName "kube-api-access-fgldf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:44:28.897661 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.897632 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-util" (OuterVolumeSpecName: "util") pod "fb4cf507-c34f-46e8-b2fb-60ee96cac357" (UID: "fb4cf507-c34f-46e8-b2fb-60ee96cac357"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:44:28.992855 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.992819 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:44:28.992855 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.992848 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgldf\" (UniqueName: \"kubernetes.io/projected/fb4cf507-c34f-46e8-b2fb-60ee96cac357-kube-api-access-fgldf\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:44:28.992855 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:28.992858 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4cf507-c34f-46e8-b2fb-60ee96cac357-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:44:29.610948 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:29.610917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" event={"ID":"fb4cf507-c34f-46e8-b2fb-60ee96cac357","Type":"ContainerDied","Data":"2cffc9d07594f5f42c410ac1a06cfd4992436e9d1d6a2058ee4db3fe39f3a262"} Jul 13 19:44:29.610948 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:29.610936 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404fhhr" Jul 13 19:44:29.611155 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:29.610969 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cffc9d07594f5f42c410ac1a06cfd4992436e9d1d6a2058ee4db3fe39f3a262" Jul 13 19:44:33.615101 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:33.615011 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:33.955917 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:33.955889 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:35.648927 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.648897 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb"] Jul 13 19:44:35.649316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649224 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="extract" Jul 13 19:44:35.649316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649236 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="extract" Jul 13 19:44:35.649316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649264 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="pull" Jul 13 19:44:35.649316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649274 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="pull" Jul 13 19:44:35.649316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649290 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="util" Jul 13 19:44:35.649316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649297 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="util" Jul 13 19:44:35.649502 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.649354 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4cf507-c34f-46e8-b2fb-60ee96cac357" containerName="extract" Jul 13 19:44:35.651834 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.651817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.654482 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.654459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:44:35.654604 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.654478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 19:44:35.654604 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.654561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h8mcc\"" Jul 13 19:44:35.666888 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.666864 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb"] Jul 13 19:44:35.757312 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.757271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9548d902-2b79-4fe7-9d68-06d35657ae91-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5mvb\" (UID: \"9548d902-2b79-4fe7-9d68-06d35657ae91\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.757517 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.757425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brb9h\" (UniqueName: \"kubernetes.io/projected/9548d902-2b79-4fe7-9d68-06d35657ae91-kube-api-access-brb9h\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5mvb\" (UID: \"9548d902-2b79-4fe7-9d68-06d35657ae91\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.858771 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.858731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brb9h\" (UniqueName: \"kubernetes.io/projected/9548d902-2b79-4fe7-9d68-06d35657ae91-kube-api-access-brb9h\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5mvb\" (UID: \"9548d902-2b79-4fe7-9d68-06d35657ae91\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.858955 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.858785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9548d902-2b79-4fe7-9d68-06d35657ae91-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5mvb\" (UID: \"9548d902-2b79-4fe7-9d68-06d35657ae91\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.859146 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.859122 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9548d902-2b79-4fe7-9d68-06d35657ae91-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5mvb\" (UID: \"9548d902-2b79-4fe7-9d68-06d35657ae91\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.868020 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.867996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brb9h\" (UniqueName: \"kubernetes.io/projected/9548d902-2b79-4fe7-9d68-06d35657ae91-kube-api-access-brb9h\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5mvb\" (UID: \"9548d902-2b79-4fe7-9d68-06d35657ae91\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:35.960756 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:35.960729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" Jul 13 19:44:36.102294 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:36.102238 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb"] Jul 13 19:44:36.104068 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:44:36.104036 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9548d902_2b79_4fe7_9d68_06d35657ae91.slice/crio-757b6d4fe33fd24b5b9edcaf89c05917b2e7efe1df9ce8c7b93e4ea8ca8a734b WatchSource:0}: Error finding container 757b6d4fe33fd24b5b9edcaf89c05917b2e7efe1df9ce8c7b93e4ea8ca8a734b: Status 404 returned error can't find the container with id 757b6d4fe33fd24b5b9edcaf89c05917b2e7efe1df9ce8c7b93e4ea8ca8a734b Jul 13 19:44:36.640722 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:36.640686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" event={"ID":"9548d902-2b79-4fe7-9d68-06d35657ae91","Type":"ContainerStarted","Data":"757b6d4fe33fd24b5b9edcaf89c05917b2e7efe1df9ce8c7b93e4ea8ca8a734b"} Jul 13 19:44:37.413454 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:37.413413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:37.746234 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:37.746195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:38.652310 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:38.652273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" event={"ID":"9548d902-2b79-4fe7-9d68-06d35657ae91","Type":"ContainerStarted","Data":"c80c79a9455a4cbae932baaee6505d732a1e89b9951df41b3ea36df1c45ece2b"} Jul 13 19:44:38.676737 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:38.676678 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5mvb" podStartSLOduration=1.863524108 podStartE2EDuration="3.676662701s" totalImagesPullingTime="1.813138593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:44:38.675407106 +0000 UTC m=+267.787602168" watchObservedRunningTime="2026-07-13 19:44:38.676662701 +0000 UTC m=+267.788857752" Jul 13 19:44:39.116434 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.116391 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:39.228500 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.228453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:39.275289 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.275241 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb"] Jul 13 19:44:39.278798 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.278782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.282566 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.282545 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h9z9\"" Jul 13 19:44:39.282704 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.282549 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 19:44:39.282704 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.282623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 19:44:39.291579 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.291554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb"] Jul 13 19:44:39.392056 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.391965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpgvc\" (UniqueName: \"kubernetes.io/projected/653bf862-4579-4a09-bbb7-6260297b5269-kube-api-access-jpgvc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.392056 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.392005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.392284 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.392091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.493040 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.493007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpgvc\" (UniqueName: \"kubernetes.io/projected/653bf862-4579-4a09-bbb7-6260297b5269-kube-api-access-jpgvc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.493217 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.493048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.493217 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.493191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.493520 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.493504 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.493572 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.493534 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.512535 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.512503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpgvc\" (UniqueName: \"kubernetes.io/projected/653bf862-4579-4a09-bbb7-6260297b5269-kube-api-access-jpgvc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.588450 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.588413 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:39.732231 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.732200 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb"] Jul 13 19:44:39.735276 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:44:39.735221 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653bf862_4579_4a09_bbb7_6260297b5269.slice/crio-a4c9f60f64b800af8d0438ec8a617a14df7bd0478a16fe78f0d38c1ac85a52cb WatchSource:0}: Error finding container a4c9f60f64b800af8d0438ec8a617a14df7bd0478a16fe78f0d38c1ac85a52cb: Status 404 returned error can't find the container with id a4c9f60f64b800af8d0438ec8a617a14df7bd0478a16fe78f0d38c1ac85a52cb Jul 13 19:44:39.790846 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.790808 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vbp2c"] Jul 13 19:44:39.795034 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.795012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:39.797609 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.797588 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 19:44:39.797609 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.797604 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 19:44:39.804242 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.804221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vbp2c"] Jul 13 19:44:39.896621 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.896518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28l5d\" (UniqueName: \"kubernetes.io/projected/fa5134ac-fee1-41a6-8e7d-4fc984e9d00d-kube-api-access-28l5d\") pod \"cert-manager-webhook-6486ffd997-vbp2c\" (UID: \"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:39.896621 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.896579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa5134ac-fee1-41a6-8e7d-4fc984e9d00d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vbp2c\" (UID: \"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:39.899806 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.899761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:39.997739 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.997705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28l5d\" (UniqueName: \"kubernetes.io/projected/fa5134ac-fee1-41a6-8e7d-4fc984e9d00d-kube-api-access-28l5d\") pod \"cert-manager-webhook-6486ffd997-vbp2c\" (UID: \"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:39.997891 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:39.997769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa5134ac-fee1-41a6-8e7d-4fc984e9d00d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vbp2c\" (UID: \"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:40.000890 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.000852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:40.008831 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.008806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa5134ac-fee1-41a6-8e7d-4fc984e9d00d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vbp2c\" (UID: \"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:40.008979 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.008924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28l5d\" (UniqueName: \"kubernetes.io/projected/fa5134ac-fee1-41a6-8e7d-4fc984e9d00d-kube-api-access-28l5d\") pod \"cert-manager-webhook-6486ffd997-vbp2c\" (UID: \"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:40.112776 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.112735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:40.254037 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.254003 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vbp2c"] Jul 13 19:44:40.256890 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:44:40.256861 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa5134ac_fee1_41a6_8e7d_4fc984e9d00d.slice/crio-df3eceb577f869434810374fce6ae91fcf2dfa441ae87d110379967c83e6264c WatchSource:0}: Error finding container df3eceb577f869434810374fce6ae91fcf2dfa441ae87d110379967c83e6264c: Status 404 returned error can't find the container with id df3eceb577f869434810374fce6ae91fcf2dfa441ae87d110379967c83e6264c Jul 13 19:44:40.666325 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.666290 2576 generic.go:356] "Generic (PLEG): container finished" podID="653bf862-4579-4a09-bbb7-6260297b5269" containerID="4c5f0f2f77330fc2122ce26558aa94fa3395f08037c5bb64668c87e2ddc92504" exitCode=0 Jul 13 19:44:40.666482 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.666372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" event={"ID":"653bf862-4579-4a09-bbb7-6260297b5269","Type":"ContainerDied","Data":"4c5f0f2f77330fc2122ce26558aa94fa3395f08037c5bb64668c87e2ddc92504"} Jul 13 19:44:40.666482 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.666424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" event={"ID":"653bf862-4579-4a09-bbb7-6260297b5269","Type":"ContainerStarted","Data":"a4c9f60f64b800af8d0438ec8a617a14df7bd0478a16fe78f0d38c1ac85a52cb"} Jul 13 19:44:40.667642 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:40.667621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" event={"ID":"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d","Type":"ContainerStarted","Data":"df3eceb577f869434810374fce6ae91fcf2dfa441ae87d110379967c83e6264c"} Jul 13 19:44:41.860780 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:41.860742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:42.268053 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:42.268016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:42.680325 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:42.680282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" event={"ID":"653bf862-4579-4a09-bbb7-6260297b5269","Type":"ContainerStarted","Data":"9b71c485a9f98ea0f36b74ea54a5f7b8a5f496cba92304b83c23027b5aaec7cd"} Jul 13 19:44:43.687328 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:43.687286 2576 generic.go:356] "Generic (PLEG): container finished" podID="653bf862-4579-4a09-bbb7-6260297b5269" containerID="9b71c485a9f98ea0f36b74ea54a5f7b8a5f496cba92304b83c23027b5aaec7cd" exitCode=0 Jul 13 19:44:43.687740 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:43.687375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" event={"ID":"653bf862-4579-4a09-bbb7-6260297b5269","Type":"ContainerDied","Data":"9b71c485a9f98ea0f36b74ea54a5f7b8a5f496cba92304b83c23027b5aaec7cd"} Jul 13 19:44:44.207101 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:44.207061 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:44.267145 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:44.267095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:44.694017 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:44.693985 2576 generic.go:356] "Generic (PLEG): container finished" podID="653bf862-4579-4a09-bbb7-6260297b5269" containerID="415508c8cfc0a5f9edb7bfe728396daf1e4be8d508ab01fee6d3fe7d0a78ef84" exitCode=0 Jul 13 19:44:44.694416 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:44.694064 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" event={"ID":"653bf862-4579-4a09-bbb7-6260297b5269","Type":"ContainerDied","Data":"415508c8cfc0a5f9edb7bfe728396daf1e4be8d508ab01fee6d3fe7d0a78ef84"} Jul 13 19:44:45.700267 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.700212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" event={"ID":"fa5134ac-fee1-41a6-8e7d-4fc984e9d00d","Type":"ContainerStarted","Data":"ab6c9880cabddf20fab0d99b7760322d8c80ca8cd4ac30e15b560cf172cc4fa2"} Jul 13 19:44:45.720292 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.720210 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" podStartSLOduration=2.3013813929999998 podStartE2EDuration="6.720190315s" totalImagesPullingTime="4.418808922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:44:45.719604655 +0000 UTC m=+274.831799705" watchObservedRunningTime="2026-07-13 19:44:45.720190315 +0000 UTC m=+274.832385366" Jul 13 19:44:45.831535 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.831507 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:45.855811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.855785 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpgvc\" (UniqueName: \"kubernetes.io/projected/653bf862-4579-4a09-bbb7-6260297b5269-kube-api-access-jpgvc\") pod \"653bf862-4579-4a09-bbb7-6260297b5269\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " Jul 13 19:44:45.855943 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.855817 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-util\") pod \"653bf862-4579-4a09-bbb7-6260297b5269\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " Jul 13 19:44:45.855943 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.855857 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-bundle\") pod \"653bf862-4579-4a09-bbb7-6260297b5269\" (UID: \"653bf862-4579-4a09-bbb7-6260297b5269\") " Jul 13 19:44:45.856272 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.856229 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-bundle" (OuterVolumeSpecName: "bundle") pod "653bf862-4579-4a09-bbb7-6260297b5269" (UID: "653bf862-4579-4a09-bbb7-6260297b5269"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:44:45.858039 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.858015 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653bf862-4579-4a09-bbb7-6260297b5269-kube-api-access-jpgvc" (OuterVolumeSpecName: "kube-api-access-jpgvc") pod "653bf862-4579-4a09-bbb7-6260297b5269" (UID: "653bf862-4579-4a09-bbb7-6260297b5269"). InnerVolumeSpecName "kube-api-access-jpgvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:44:45.860729 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.860682 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-util" (OuterVolumeSpecName: "util") pod "653bf862-4579-4a09-bbb7-6260297b5269" (UID: "653bf862-4579-4a09-bbb7-6260297b5269"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:44:45.957389 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.957349 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:44:45.957389 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.957389 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpgvc\" (UniqueName: \"kubernetes.io/projected/653bf862-4579-4a09-bbb7-6260297b5269-kube-api-access-jpgvc\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:44:45.957583 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:45.957405 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/653bf862-4579-4a09-bbb7-6260297b5269-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:44:46.707123 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:46.707092 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" Jul 13 19:44:46.707510 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:46.707121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hgvb" event={"ID":"653bf862-4579-4a09-bbb7-6260297b5269","Type":"ContainerDied","Data":"a4c9f60f64b800af8d0438ec8a617a14df7bd0478a16fe78f0d38c1ac85a52cb"} Jul 13 19:44:46.707510 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:46.707174 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4c9f60f64b800af8d0438ec8a617a14df7bd0478a16fe78f0d38c1ac85a52cb" Jul 13 19:44:46.707510 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:46.707481 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:49.864028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:49.863991 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:50.248728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.248693 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qlkv9"] Jul 13 19:44:50.249014 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249002 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="util" Jul 13 19:44:50.249067 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249017 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="util" Jul 13 19:44:50.249067 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249035 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="extract" Jul 13 19:44:50.249067 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249040 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="extract" Jul 13 19:44:50.249067 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249048 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="pull" Jul 13 19:44:50.249067 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249053 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="pull" Jul 13 19:44:50.249212 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.249108 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="653bf862-4579-4a09-bbb7-6260297b5269" containerName="extract" Jul 13 19:44:50.253399 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.253383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.255694 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.255671 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qpnnq\"" Jul 13 19:44:50.262011 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.261991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qlkv9"] Jul 13 19:44:50.296136 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.296092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da22417d-9135-4ae8-b4e1-3225f1230f9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-qlkv9\" (UID: \"da22417d-9135-4ae8-b4e1-3225f1230f9f\") " pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.296334 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.296157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxpff\" (UniqueName: \"kubernetes.io/projected/da22417d-9135-4ae8-b4e1-3225f1230f9f-kube-api-access-lxpff\") pod \"cert-manager-55b4d954d5-qlkv9\" (UID: \"da22417d-9135-4ae8-b4e1-3225f1230f9f\") " pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.397060 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.397023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxpff\" (UniqueName: \"kubernetes.io/projected/da22417d-9135-4ae8-b4e1-3225f1230f9f-kube-api-access-lxpff\") pod \"cert-manager-55b4d954d5-qlkv9\" (UID: \"da22417d-9135-4ae8-b4e1-3225f1230f9f\") " pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.397328 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.397152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da22417d-9135-4ae8-b4e1-3225f1230f9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-qlkv9\" (UID: \"da22417d-9135-4ae8-b4e1-3225f1230f9f\") " pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.405021 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.404986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da22417d-9135-4ae8-b4e1-3225f1230f9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-qlkv9\" (UID: \"da22417d-9135-4ae8-b4e1-3225f1230f9f\") " pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.405119 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.405088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxpff\" (UniqueName: \"kubernetes.io/projected/da22417d-9135-4ae8-b4e1-3225f1230f9f-kube-api-access-lxpff\") pod \"cert-manager-55b4d954d5-qlkv9\" (UID: \"da22417d-9135-4ae8-b4e1-3225f1230f9f\") " pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.563361 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.563277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qlkv9" Jul 13 19:44:50.695997 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.695970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qlkv9"] Jul 13 19:44:50.698466 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:44:50.698434 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda22417d_9135_4ae8_b4e1_3225f1230f9f.slice/crio-045477a107021883943faf5f8773c33118e6a1406a62bf5fb6c9c2f11e85877d WatchSource:0}: Error finding container 045477a107021883943faf5f8773c33118e6a1406a62bf5fb6c9c2f11e85877d: Status 404 returned error can't find the container with id 045477a107021883943faf5f8773c33118e6a1406a62bf5fb6c9c2f11e85877d Jul 13 19:44:50.727873 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:50.727841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qlkv9" event={"ID":"da22417d-9135-4ae8-b4e1-3225f1230f9f","Type":"ContainerStarted","Data":"045477a107021883943faf5f8773c33118e6a1406a62bf5fb6c9c2f11e85877d"} Jul 13 19:44:51.082511 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:51.082475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:51.137452 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:51.137416 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:51.473351 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:51.473318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:51.580619 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:51.580585 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:51.733575 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:51.733477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qlkv9" event={"ID":"da22417d-9135-4ae8-b4e1-3225f1230f9f","Type":"ContainerStarted","Data":"251e15b3f82ad5932ca757cff4906eb7b588a125e24c85939c89c65230c8a618"} Jul 13 19:44:51.749715 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:51.749663 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qlkv9" podStartSLOduration=1.749649359 podStartE2EDuration="1.749649359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:44:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:44:51.748369428 +0000 UTC m=+280.860564473" watchObservedRunningTime="2026-07-13 19:44:51.749649359 +0000 UTC m=+280.861844410" Jul 13 19:44:52.714038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:52.714007 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vbp2c" Jul 13 19:44:53.395068 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.395034 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf"] Jul 13 19:44:53.432664 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.432635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf"] Jul 13 19:44:53.432810 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.432728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.438944 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.438919 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:44:53.439887 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.439867 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n9cdq\"" Jul 13 19:44:53.440051 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.439866 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 19:44:53.524359 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.524325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjtb\" (UniqueName: \"kubernetes.io/projected/e28edbbe-0904-4370-ab70-1d595dd83a1c-kube-api-access-lwjtb\") pod \"openshift-lws-operator-fd8ccff4c-4vbgf\" (UID: \"e28edbbe-0904-4370-ab70-1d595dd83a1c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.524526 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.524369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e28edbbe-0904-4370-ab70-1d595dd83a1c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4vbgf\" (UID: \"e28edbbe-0904-4370-ab70-1d595dd83a1c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.625702 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.625660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjtb\" (UniqueName: \"kubernetes.io/projected/e28edbbe-0904-4370-ab70-1d595dd83a1c-kube-api-access-lwjtb\") pod \"openshift-lws-operator-fd8ccff4c-4vbgf\" (UID: \"e28edbbe-0904-4370-ab70-1d595dd83a1c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.625702 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.625704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e28edbbe-0904-4370-ab70-1d595dd83a1c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4vbgf\" (UID: \"e28edbbe-0904-4370-ab70-1d595dd83a1c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.626108 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.626090 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e28edbbe-0904-4370-ab70-1d595dd83a1c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4vbgf\" (UID: \"e28edbbe-0904-4370-ab70-1d595dd83a1c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.639869 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.639841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjtb\" (UniqueName: \"kubernetes.io/projected/e28edbbe-0904-4370-ab70-1d595dd83a1c-kube-api-access-lwjtb\") pod \"openshift-lws-operator-fd8ccff4c-4vbgf\" (UID: \"e28edbbe-0904-4370-ab70-1d595dd83a1c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.742005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.741968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" Jul 13 19:44:53.904446 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:53.904424 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf"] Jul 13 19:44:53.906448 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:44:53.906420 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode28edbbe_0904_4370_ab70_1d595dd83a1c.slice/crio-b56720114872d6e85d9766b862e4c3f3cd282cc12ffdf2bfd501fa5194b304f2 WatchSource:0}: Error finding container b56720114872d6e85d9766b862e4c3f3cd282cc12ffdf2bfd501fa5194b304f2: Status 404 returned error can't find the container with id b56720114872d6e85d9766b862e4c3f3cd282cc12ffdf2bfd501fa5194b304f2 Jul 13 19:44:54.748203 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:54.748166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" event={"ID":"e28edbbe-0904-4370-ab70-1d595dd83a1c","Type":"ContainerStarted","Data":"b56720114872d6e85d9766b862e4c3f3cd282cc12ffdf2bfd501fa5194b304f2"} Jul 13 19:44:57.764544 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:57.764447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" event={"ID":"e28edbbe-0904-4370-ab70-1d595dd83a1c","Type":"ContainerStarted","Data":"ec96365b654bdd3b8dd2486a3cb148632231598c7fd89b064e323b526be8c189"} Jul 13 19:44:57.785388 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:57.785332 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vbgf" podStartSLOduration=1.185828712 podStartE2EDuration="4.785313032s" totalImagesPullingTime="3.59948432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:44:57.783502231 +0000 UTC m=+286.895697282" watchObservedRunningTime="2026-07-13 19:44:57.785313032 +0000 UTC m=+286.897508083" Jul 13 19:44:58.519806 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:58.519774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:58.620693 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:58.620656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:59.921986 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.921952 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f"] Jul 13 19:44:59.925421 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.925396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:44:59.927821 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.927799 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 19:44:59.928746 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.928725 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 19:44:59.928842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.928725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h9z9\"" Jul 13 19:44:59.934652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.934628 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f"] Jul 13 19:44:59.979738 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.979706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:44:59.979738 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.979754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:44:59.979973 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:44:59.979814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmhhp\" (UniqueName: \"kubernetes.io/projected/b004e208-f3fa-479b-8c2d-3be68beded33-kube-api-access-kmhhp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.080685 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.080648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.080884 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.080693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.080884 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.080725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmhhp\" (UniqueName: \"kubernetes.io/projected/b004e208-f3fa-479b-8c2d-3be68beded33-kube-api-access-kmhhp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.081130 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.081108 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.081201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.081111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.090177 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.090151 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmhhp\" (UniqueName: \"kubernetes.io/projected/b004e208-f3fa-479b-8c2d-3be68beded33-kube-api-access-kmhhp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.235060 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.235011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:00.373139 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.373113 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f"] Jul 13 19:45:00.375570 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:45:00.375534 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb004e208_f3fa_479b_8c2d_3be68beded33.slice/crio-a8c298093770964796377ae2d7e1bbba7f5d5b6bf046ba162d5d587628af3619 WatchSource:0}: Error finding container a8c298093770964796377ae2d7e1bbba7f5d5b6bf046ba162d5d587628af3619: Status 404 returned error can't find the container with id a8c298093770964796377ae2d7e1bbba7f5d5b6bf046ba162d5d587628af3619 Jul 13 19:45:00.782414 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.782379 2576 generic.go:356] "Generic (PLEG): container finished" podID="b004e208-f3fa-479b-8c2d-3be68beded33" containerID="eaef441e8708402c8e90f553801b24b7e3dd889261690d9ca896162e2a68b9d1" exitCode=0 Jul 13 19:45:00.782414 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.782420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" event={"ID":"b004e208-f3fa-479b-8c2d-3be68beded33","Type":"ContainerDied","Data":"eaef441e8708402c8e90f553801b24b7e3dd889261690d9ca896162e2a68b9d1"} Jul 13 19:45:00.782633 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.782455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" event={"ID":"b004e208-f3fa-479b-8c2d-3be68beded33","Type":"ContainerStarted","Data":"a8c298093770964796377ae2d7e1bbba7f5d5b6bf046ba162d5d587628af3619"} Jul 13 19:45:00.979806 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:00.979765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:02.793007 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:02.792974 2576 generic.go:356] "Generic (PLEG): container finished" podID="b004e208-f3fa-479b-8c2d-3be68beded33" containerID="ed0ab85833b4b41f343e64e4fb8e64ed7bc7f745d506638803a76c5b0927e80e" exitCode=0 Jul 13 19:45:02.793426 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:02.793037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" event={"ID":"b004e208-f3fa-479b-8c2d-3be68beded33","Type":"ContainerDied","Data":"ed0ab85833b4b41f343e64e4fb8e64ed7bc7f745d506638803a76c5b0927e80e"} Jul 13 19:45:03.799886 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:03.799855 2576 generic.go:356] "Generic (PLEG): container finished" podID="b004e208-f3fa-479b-8c2d-3be68beded33" containerID="5dfb12d428c6a8414f5342b72b267d03056d8b87aab580dcf45c01bddc536af7" exitCode=0 Jul 13 19:45:03.800330 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:03.799940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" event={"ID":"b004e208-f3fa-479b-8c2d-3be68beded33","Type":"ContainerDied","Data":"5dfb12d428c6a8414f5342b72b267d03056d8b87aab580dcf45c01bddc536af7"} Jul 13 19:45:04.932285 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:04.932262 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:05.020802 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.020772 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-util\") pod \"b004e208-f3fa-479b-8c2d-3be68beded33\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " Jul 13 19:45:05.020999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.020840 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-bundle\") pod \"b004e208-f3fa-479b-8c2d-3be68beded33\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " Jul 13 19:45:05.020999 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.020907 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmhhp\" (UniqueName: \"kubernetes.io/projected/b004e208-f3fa-479b-8c2d-3be68beded33-kube-api-access-kmhhp\") pod \"b004e208-f3fa-479b-8c2d-3be68beded33\" (UID: \"b004e208-f3fa-479b-8c2d-3be68beded33\") " Jul 13 19:45:05.021517 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.021493 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-bundle" (OuterVolumeSpecName: "bundle") pod "b004e208-f3fa-479b-8c2d-3be68beded33" (UID: "b004e208-f3fa-479b-8c2d-3be68beded33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:45:05.023098 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.023078 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b004e208-f3fa-479b-8c2d-3be68beded33-kube-api-access-kmhhp" (OuterVolumeSpecName: "kube-api-access-kmhhp") pod "b004e208-f3fa-479b-8c2d-3be68beded33" (UID: "b004e208-f3fa-479b-8c2d-3be68beded33"). InnerVolumeSpecName "kube-api-access-kmhhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:45:05.026436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.026401 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-util" (OuterVolumeSpecName: "util") pod "b004e208-f3fa-479b-8c2d-3be68beded33" (UID: "b004e208-f3fa-479b-8c2d-3be68beded33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:45:05.121665 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.121579 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:45:05.121665 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.121610 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmhhp\" (UniqueName: \"kubernetes.io/projected/b004e208-f3fa-479b-8c2d-3be68beded33-kube-api-access-kmhhp\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:45:05.121665 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.121620 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b004e208-f3fa-479b-8c2d-3be68beded33-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:45:05.811448 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.811410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" event={"ID":"b004e208-f3fa-479b-8c2d-3be68beded33","Type":"ContainerDied","Data":"a8c298093770964796377ae2d7e1bbba7f5d5b6bf046ba162d5d587628af3619"} Jul 13 19:45:05.811448 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.811432 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbgr4f" Jul 13 19:45:05.811723 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:05.811460 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8c298093770964796377ae2d7e1bbba7f5d5b6bf046ba162d5d587628af3619" Jul 13 19:45:11.250926 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:11.250900 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:45:11.255610 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:11.255591 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:45:11.260837 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:11.260806 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:45:11.269295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:11.269272 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 19:45:11.270036 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:11.270016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:45:16.326077 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:16.326025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:17.228959 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.228924 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c"] Jul 13 19:45:17.229303 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229290 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="extract" Jul 13 19:45:17.229362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229305 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="extract" Jul 13 19:45:17.229362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229334 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="pull" Jul 13 19:45:17.229362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229339 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="pull" Jul 13 19:45:17.229362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229347 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="util" Jul 13 19:45:17.229362 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229352 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="util" Jul 13 19:45:17.229513 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.229415 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b004e208-f3fa-479b-8c2d-3be68beded33" containerName="extract" Jul 13 19:45:17.232528 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.232509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.238744 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.238718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 19:45:17.239106 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.239088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 19:45:17.239201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.239093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 19:45:17.239653 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.239407 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-74247\"" Jul 13 19:45:17.239653 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.239412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 19:45:17.253092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.253059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c"] Jul 13 19:45:17.325449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.325410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-manifests\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.325662 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.325477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-tmp\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.325662 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.325500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.325662 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.325556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-webhook-cert\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.325662 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.325602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zghmg\" (UniqueName: \"kubernetes.io/projected/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-kube-api-access-zghmg\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.426227 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.426186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-manifests\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.426728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.426277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-tmp\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.426728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.426303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.426728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.426366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-webhook-cert\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.426728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.426409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zghmg\" (UniqueName: \"kubernetes.io/projected/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-kube-api-access-zghmg\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.426728 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.426622 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-manifests\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.428862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.428830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-tmp\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.428973 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.428917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-webhook-cert\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.428973 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.428926 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.438761 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.438735 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zghmg\" (UniqueName: \"kubernetes.io/projected/d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4-kube-api-access-zghmg\") pod \"opendatahub-operator-controller-manager-747899cbfc-bdz6c\" (UID: \"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4\") " pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.542816 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.542728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:17.720473 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.720439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c"] Jul 13 19:45:17.725990 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:45:17.725962 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c9b12f_c012_4ab9_af4f_c33ffbf3ecc4.slice/crio-e607860a77970a50e89259dcfc78600f0a5e1afa728687d4c93b1490cd1a872d WatchSource:0}: Error finding container e607860a77970a50e89259dcfc78600f0a5e1afa728687d4c93b1490cd1a872d: Status 404 returned error can't find the container with id e607860a77970a50e89259dcfc78600f0a5e1afa728687d4c93b1490cd1a872d Jul 13 19:45:17.728099 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.728078 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 19:45:17.869366 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:17.869275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" event={"ID":"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4","Type":"ContainerStarted","Data":"e607860a77970a50e89259dcfc78600f0a5e1afa728687d4c93b1490cd1a872d"} Jul 13 19:45:18.543211 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:18.543179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:21.893197 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:21.893158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" event={"ID":"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4","Type":"ContainerStarted","Data":"ef0c7621d1f2587dcec3bd0db65164c7f649fa2ebbaa3f61b0c6709032c0228b"} Jul 13 19:45:22.900428 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:22.900338 2576 generic.go:356] "Generic (PLEG): container finished" podID="d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4" containerID="ef0c7621d1f2587dcec3bd0db65164c7f649fa2ebbaa3f61b0c6709032c0228b" exitCode=0 Jul 13 19:45:22.900811 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:22.900423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" event={"ID":"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4","Type":"ContainerDied","Data":"ef0c7621d1f2587dcec3bd0db65164c7f649fa2ebbaa3f61b0c6709032c0228b"} Jul 13 19:45:23.906993 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:23.906959 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" event={"ID":"d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4","Type":"ContainerStarted","Data":"1a4d284772e39be91d10fbfc0cd988c708b0381a1c08733e679b8239be5ae02f"} Jul 13 19:45:23.907377 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:23.907046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:23.927586 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:23.927540 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" podStartSLOduration=1.933801215 podStartE2EDuration="6.927524536s" totalImagesPullingTime="3.871351371s" totalInitContainerRuntime="1.12237195s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:45:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:45:23.926321388 +0000 UTC m=+313.038516438" watchObservedRunningTime="2026-07-13 19:45:23.927524536 +0000 UTC m=+313.039719586" Jul 13 19:45:25.278436 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:25.278379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:25.350838 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:25.350800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:34.914635 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:34.914605 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-747899cbfc-bdz6c" Jul 13 19:45:36.646620 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:36.646584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:36.779971 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:36.779924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:37.233567 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.233531 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:37.357697 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.357660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84785469bd-zc42h"] Jul 13 19:45:37.361456 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.361434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.364479 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.364455 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sn2sl\"" Jul 13 19:45:37.365392 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.365378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 19:45:37.366550 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.366530 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 19:45:37.380607 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.380582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84785469bd-zc42h"] Jul 13 19:45:37.385231 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.385204 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:37.413495 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.413464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8385fdd1-a4a0-4fff-b95a-3093d98147da-tls-certs\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.413656 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.413509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr9fs\" (UniqueName: \"kubernetes.io/projected/8385fdd1-a4a0-4fff-b95a-3093d98147da-kube-api-access-wr9fs\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.413656 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.413602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8385fdd1-a4a0-4fff-b95a-3093d98147da-tmp\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.503038 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.502932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:37.515060 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.515033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8385fdd1-a4a0-4fff-b95a-3093d98147da-tls-certs\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.515214 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.515081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr9fs\" (UniqueName: \"kubernetes.io/projected/8385fdd1-a4a0-4fff-b95a-3093d98147da-kube-api-access-wr9fs\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.515214 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.515153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8385fdd1-a4a0-4fff-b95a-3093d98147da-tmp\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.517536 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.517507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8385fdd1-a4a0-4fff-b95a-3093d98147da-tmp\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.517776 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.517758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8385fdd1-a4a0-4fff-b95a-3093d98147da-tls-certs\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.525989 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.525961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr9fs\" (UniqueName: \"kubernetes.io/projected/8385fdd1-a4a0-4fff-b95a-3093d98147da-kube-api-access-wr9fs\") pod \"kube-auth-proxy-84785469bd-zc42h\" (UID: \"8385fdd1-a4a0-4fff-b95a-3093d98147da\") " pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.600154 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.600111 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:37.672109 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.672074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" Jul 13 19:45:37.814480 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.814454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84785469bd-zc42h"] Jul 13 19:45:37.817048 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:45:37.817021 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8385fdd1_a4a0_4fff_b95a_3093d98147da.slice/crio-9ab6c2edb99ad7830410ffc1c0241b8830bc07cfc4588545e8737d12e953cea5 WatchSource:0}: Error finding container 9ab6c2edb99ad7830410ffc1c0241b8830bc07cfc4588545e8737d12e953cea5: Status 404 returned error can't find the container with id 9ab6c2edb99ad7830410ffc1c0241b8830bc07cfc4588545e8737d12e953cea5 Jul 13 19:45:37.827407 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.827377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:37.980930 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:37.980895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" event={"ID":"8385fdd1-a4a0-4fff-b95a-3093d98147da","Type":"ContainerStarted","Data":"9ab6c2edb99ad7830410ffc1c0241b8830bc07cfc4588545e8737d12e953cea5"} Jul 13 19:45:38.187760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:38.187674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:38.662079 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:38.662050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:38.752426 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:38.752374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:39.807502 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:39.807465 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:42.003241 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:42.003202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" event={"ID":"8385fdd1-a4a0-4fff-b95a-3093d98147da","Type":"ContainerStarted","Data":"51dc5ae457360587c420f71c7657c8fb7eb6fc75e9e0bb847cb9e5bd75ca0c9f"} Jul 13 19:45:42.019864 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:42.019810 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84785469bd-zc42h" podStartSLOduration=1.428615687 podStartE2EDuration="5.019796379s" totalImagesPullingTime="3.591180692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:45:42.018677141 +0000 UTC m=+331.130872193" watchObservedRunningTime="2026-07-13 19:45:42.019796379 +0000 UTC m=+331.131991431" Jul 13 19:45:45.821092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.821050 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l"] Jul 13 19:45:45.824512 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.824497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.826969 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.826944 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 19:45:45.827110 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.826957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6nk6r\"" Jul 13 19:45:45.827110 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.826997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 19:45:45.827110 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.826960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 19:45:45.827587 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.827571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 19:45:45.839722 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.839697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l"] Jul 13 19:45:45.891389 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.891571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.891571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.891571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.891571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.891571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t26cv\" (UniqueName: \"kubernetes.io/projected/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-kube-api-access-t26cv\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.891762 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.891590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992574 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992574 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t26cv\" (UniqueName: \"kubernetes.io/projected/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-kube-api-access-t26cv\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.992814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.992738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.993559 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.993426 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.995092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.995070 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.995221 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.995201 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.995443 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.995426 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:45.995580 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:45.995562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:46.002814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:46.002788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t26cv\" (UniqueName: \"kubernetes.io/projected/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-kube-api-access-t26cv\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:46.003386 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:46.003360 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f49298-684d-4a58-9e84-b2cb9a3fa82e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jch4l\" (UID: \"c0f49298-684d-4a58-9e84-b2cb9a3fa82e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:46.133560 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:46.133468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:46.283233 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:46.283206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l"] Jul 13 19:45:46.285734 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:45:46.285688 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f49298_684d_4a58_9e84_b2cb9a3fa82e.slice/crio-fe1564d42250b08d2ab84b7ef5e6459dcaba510cb85d3e80b4f4ef8cf5ecd9b5 WatchSource:0}: Error finding container fe1564d42250b08d2ab84b7ef5e6459dcaba510cb85d3e80b4f4ef8cf5ecd9b5: Status 404 returned error can't find the container with id fe1564d42250b08d2ab84b7ef5e6459dcaba510cb85d3e80b4f4ef8cf5ecd9b5 Jul 13 19:45:47.031134 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:47.031092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" event={"ID":"c0f49298-684d-4a58-9e84-b2cb9a3fa82e","Type":"ContainerStarted","Data":"fe1564d42250b08d2ab84b7ef5e6459dcaba510cb85d3e80b4f4ef8cf5ecd9b5"} Jul 13 19:45:48.619437 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:48.619398 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:45:48.619730 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:48.619467 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:45:48.969474 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:48.969434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:49.044281 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.044214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" event={"ID":"c0f49298-684d-4a58-9e84-b2cb9a3fa82e","Type":"ContainerStarted","Data":"f6ea56722842dca297c704f0f502215f1892a03ee5b7a7724ace92e8ed6db0ca"} Jul 13 19:45:49.044477 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.044453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:49.045897 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.045867 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jch4l container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 19:45:49.046008 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.045926 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" podUID="c0f49298-684d-4a58-9e84-b2cb9a3fa82e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 19:45:49.072664 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.072632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:49.077427 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.077374 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" podStartSLOduration=1.746304393 podStartE2EDuration="4.0773569s" totalImagesPullingTime="2.331052507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:45:49.07546037 +0000 UTC m=+338.187655421" watchObservedRunningTime="2026-07-13 19:45:49.0773569 +0000 UTC m=+338.189551978" Jul 13 19:45:49.375704 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.375560 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:49.489889 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.489851 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:49.885770 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:49.885742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:50.050382 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.050356 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jch4l" Jul 13 19:45:50.115848 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.115814 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:50.327654 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.327605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:50.466646 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.466555 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:50.693136 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.693024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:50.782181 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.782155 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:45:50.849765 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:45:50.849730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:34.286757 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:34.286716 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:34.389589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:34.389552 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:36.228923 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:36.228875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:36.288838 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:36.288797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:38.248814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.248754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:38.342602 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.342550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:38.380681 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.380646 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk2j2"] Jul 13 19:46:38.384043 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.384017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:38.386610 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.386584 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-h4tld\"" Jul 13 19:46:38.387456 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.387430 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 19:46:38.387576 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.387484 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 19:46:38.393046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.392783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk2j2"] Jul 13 19:46:38.423619 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.423582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:46:38.479389 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.479347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xqh4\" (UniqueName: \"kubernetes.io/projected/796c2ddc-31c4-4ef1-b685-4ff9e8800a21-kube-api-access-9xqh4\") pod \"kuadrant-operator-catalog-dk2j2\" (UID: \"796c2ddc-31c4-4ef1-b685-4ff9e8800a21\") " pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:38.580812 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.580720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqh4\" (UniqueName: \"kubernetes.io/projected/796c2ddc-31c4-4ef1-b685-4ff9e8800a21-kube-api-access-9xqh4\") pod \"kuadrant-operator-catalog-dk2j2\" (UID: \"796c2ddc-31c4-4ef1-b685-4ff9e8800a21\") " pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:38.589176 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.589146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqh4\" (UniqueName: \"kubernetes.io/projected/796c2ddc-31c4-4ef1-b685-4ff9e8800a21-kube-api-access-9xqh4\") pod \"kuadrant-operator-catalog-dk2j2\" (UID: \"796c2ddc-31c4-4ef1-b685-4ff9e8800a21\") " pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:38.696596 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.696566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:38.832607 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.832582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk2j2"] Jul 13 19:46:38.834804 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:46:38.834776 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796c2ddc_31c4_4ef1_b685_4ff9e8800a21.slice/crio-23819540e21732dcecf21efb5830ddf60f3c0abbab45d802776e57483adc3eb9 WatchSource:0}: Error finding container 23819540e21732dcecf21efb5830ddf60f3c0abbab45d802776e57483adc3eb9: Status 404 returned error can't find the container with id 23819540e21732dcecf21efb5830ddf60f3c0abbab45d802776e57483adc3eb9 Jul 13 19:46:38.987947 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:38.987910 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk2j2"] Jul 13 19:46:39.294338 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:39.294302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" event={"ID":"796c2ddc-31c4-4ef1-b685-4ff9e8800a21","Type":"ContainerStarted","Data":"23819540e21732dcecf21efb5830ddf60f3c0abbab45d802776e57483adc3eb9"} Jul 13 19:46:42.310352 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.310305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" event={"ID":"796c2ddc-31c4-4ef1-b685-4ff9e8800a21","Type":"ContainerStarted","Data":"647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747"} Jul 13 19:46:42.310825 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.310463 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" podUID="796c2ddc-31c4-4ef1-b685-4ff9e8800a21" containerName="registry-server" containerID="cri-o://647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747" gracePeriod=2 Jul 13 19:46:42.325325 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.325187 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" podStartSLOduration=1.773902461 podStartE2EDuration="4.325166582s" totalImagesPullingTime="2.551264121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:46:42.324142456 +0000 UTC m=+391.436337508" watchObservedRunningTime="2026-07-13 19:46:42.325166582 +0000 UTC m=+391.437361634" Jul 13 19:46:42.561172 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.561107 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:42.719280 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.719223 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xqh4\" (UniqueName: \"kubernetes.io/projected/796c2ddc-31c4-4ef1-b685-4ff9e8800a21-kube-api-access-9xqh4\") pod \"796c2ddc-31c4-4ef1-b685-4ff9e8800a21\" (UID: \"796c2ddc-31c4-4ef1-b685-4ff9e8800a21\") " Jul 13 19:46:42.721508 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.721482 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796c2ddc-31c4-4ef1-b685-4ff9e8800a21-kube-api-access-9xqh4" (OuterVolumeSpecName: "kube-api-access-9xqh4") pod "796c2ddc-31c4-4ef1-b685-4ff9e8800a21" (UID: "796c2ddc-31c4-4ef1-b685-4ff9e8800a21"). InnerVolumeSpecName "kube-api-access-9xqh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:46:42.820643 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:42.820547 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xqh4\" (UniqueName: \"kubernetes.io/projected/796c2ddc-31c4-4ef1-b685-4ff9e8800a21-kube-api-access-9xqh4\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:46:43.316483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.316446 2576 generic.go:356] "Generic (PLEG): container finished" podID="796c2ddc-31c4-4ef1-b685-4ff9e8800a21" containerID="647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747" exitCode=0 Jul 13 19:46:43.316907 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.316490 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" Jul 13 19:46:43.316907 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.316532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" event={"ID":"796c2ddc-31c4-4ef1-b685-4ff9e8800a21","Type":"ContainerDied","Data":"647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747"} Jul 13 19:46:43.316907 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.316576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dk2j2" event={"ID":"796c2ddc-31c4-4ef1-b685-4ff9e8800a21","Type":"ContainerDied","Data":"23819540e21732dcecf21efb5830ddf60f3c0abbab45d802776e57483adc3eb9"} Jul 13 19:46:43.316907 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.316596 2576 scope.go:117] "RemoveContainer" containerID="647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747" Jul 13 19:46:43.326141 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.326117 2576 scope.go:117] "RemoveContainer" containerID="647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747" Jul 13 19:46:43.326467 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:46:43.326449 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747\": container with ID starting with 647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747 not found: ID does not exist" containerID="647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747" Jul 13 19:46:43.326522 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.326478 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747"} err="failed to get container status \"647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747\": rpc error: code = NotFound desc = could not find container \"647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747\": container with ID starting with 647590c4106d98b11ec6588103fee5e9dfc5c899be960fcbe0e090ab43643747 not found: ID does not exist" Jul 13 19:46:43.337404 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.337377 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk2j2"] Jul 13 19:46:43.340839 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.340816 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dk2j2"] Jul 13 19:46:43.380692 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:43.380658 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="796c2ddc-31c4-4ef1-b685-4ff9e8800a21" path="/var/lib/kubelet/pods/796c2ddc-31c4-4ef1-b685-4ff9e8800a21/volumes" Jul 13 19:46:54.432242 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.432206 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v"] Jul 13 19:46:54.432755 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.432734 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796c2ddc-31c4-4ef1-b685-4ff9e8800a21" containerName="registry-server" Jul 13 19:46:54.432849 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.432759 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="796c2ddc-31c4-4ef1-b685-4ff9e8800a21" containerName="registry-server" Jul 13 19:46:54.432908 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.432875 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="796c2ddc-31c4-4ef1-b685-4ff9e8800a21" containerName="registry-server" Jul 13 19:46:54.437327 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.437305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.439712 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.439688 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 19:46:54.439900 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.439688 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 19:46:54.440403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.440388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5kz64\"" Jul 13 19:46:54.443635 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.443614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v"] Jul 13 19:46:54.522082 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.522041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.522300 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.522150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p67h6\" (UniqueName: \"kubernetes.io/projected/0e30beee-69f7-4961-8a66-e45302f7d340-kube-api-access-p67h6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.522300 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.522183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.622875 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.622839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.623034 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.622937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p67h6\" (UniqueName: \"kubernetes.io/projected/0e30beee-69f7-4961-8a66-e45302f7d340-kube-api-access-p67h6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.623034 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.622966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.623350 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.623330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.623398 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.623340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.632288 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.632236 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p67h6\" (UniqueName: \"kubernetes.io/projected/0e30beee-69f7-4961-8a66-e45302f7d340-kube-api-access-p67h6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.747500 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.747468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:54.831829 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.831800 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw"] Jul 13 19:46:54.835565 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.835544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:54.846207 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.846141 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw"] Jul 13 19:46:54.892964 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.892932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v"] Jul 13 19:46:54.894669 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:46:54.894641 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e30beee_69f7_4961_8a66_e45302f7d340.slice/crio-a019de9af66df0c331efea5f3df434feb987ed5b9396cb4a0078a068c3ceab4e WatchSource:0}: Error finding container a019de9af66df0c331efea5f3df434feb987ed5b9396cb4a0078a068c3ceab4e: Status 404 returned error can't find the container with id a019de9af66df0c331efea5f3df434feb987ed5b9396cb4a0078a068c3ceab4e Jul 13 19:46:54.924971 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.924947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:54.925077 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.924978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:54.925077 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:54.925007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrhw\" (UniqueName: \"kubernetes.io/projected/34c149d0-9478-4589-863a-42a509b04e0e-kube-api-access-hrrhw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.026334 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.026211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.026334 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.026262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.026334 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.026290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrhw\" (UniqueName: \"kubernetes.io/projected/34c149d0-9478-4589-863a-42a509b04e0e-kube-api-access-hrrhw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.026693 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.026669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.026738 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.026677 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.034881 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.034856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrhw\" (UniqueName: \"kubernetes.io/projected/34c149d0-9478-4589-863a-42a509b04e0e-kube-api-access-hrrhw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.152963 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.152912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:55.229366 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.229333 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm"] Jul 13 19:46:55.233839 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.233817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.251271 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.241640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm"] Jul 13 19:46:55.328549 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.328521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw"] Jul 13 19:46:55.328618 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.328597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.328667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.328620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6pl8\" (UniqueName: \"kubernetes.io/projected/76dca588-cf79-42ce-a8ea-5cf81e8e4153-kube-api-access-b6pl8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.328667 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.328659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.331138 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:46:55.331114 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c149d0_9478_4589_863a_42a509b04e0e.slice/crio-f751c44b3d12aab50e32fefa27e762179b812c543d29a66debea6e549161eb25 WatchSource:0}: Error finding container f751c44b3d12aab50e32fefa27e762179b812c543d29a66debea6e549161eb25: Status 404 returned error can't find the container with id f751c44b3d12aab50e32fefa27e762179b812c543d29a66debea6e549161eb25 Jul 13 19:46:55.384779 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.384664 2576 generic.go:356] "Generic (PLEG): container finished" podID="0e30beee-69f7-4961-8a66-e45302f7d340" containerID="1d2f2715b83c08507690c8aab3e76239b01c37606e5b8a3ad05c60c929c4d594" exitCode=0 Jul 13 19:46:55.384886 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.384781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" event={"ID":"0e30beee-69f7-4961-8a66-e45302f7d340","Type":"ContainerDied","Data":"1d2f2715b83c08507690c8aab3e76239b01c37606e5b8a3ad05c60c929c4d594"} Jul 13 19:46:55.384886 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.384826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" event={"ID":"0e30beee-69f7-4961-8a66-e45302f7d340","Type":"ContainerStarted","Data":"a019de9af66df0c331efea5f3df434feb987ed5b9396cb4a0078a068c3ceab4e"} Jul 13 19:46:55.386627 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.386601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" event={"ID":"34c149d0-9478-4589-863a-42a509b04e0e","Type":"ContainerStarted","Data":"f751c44b3d12aab50e32fefa27e762179b812c543d29a66debea6e549161eb25"} Jul 13 19:46:55.429759 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.429725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.429759 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.429761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6pl8\" (UniqueName: \"kubernetes.io/projected/76dca588-cf79-42ce-a8ea-5cf81e8e4153-kube-api-access-b6pl8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.430041 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.429797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.430159 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.430131 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.430342 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.430321 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.438288 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.438232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6pl8\" (UniqueName: \"kubernetes.io/projected/76dca588-cf79-42ce-a8ea-5cf81e8e4153-kube-api-access-b6pl8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.547810 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.547768 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:46:55.691581 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.691429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm"] Jul 13 19:46:55.694062 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:46:55.694032 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76dca588_cf79_42ce_a8ea_5cf81e8e4153.slice/crio-ff9c5c5c249e9e972b960c33f6837fa13c10e18773a2ea818382c17155978c18 WatchSource:0}: Error finding container ff9c5c5c249e9e972b960c33f6837fa13c10e18773a2ea818382c17155978c18: Status 404 returned error can't find the container with id ff9c5c5c249e9e972b960c33f6837fa13c10e18773a2ea818382c17155978c18 Jul 13 19:46:55.835956 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.835926 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn"] Jul 13 19:46:55.839517 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.839493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:55.847922 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.847892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn"] Jul 13 19:46:55.934403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.934370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkt5q\" (UniqueName: \"kubernetes.io/projected/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-kube-api-access-mkt5q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:55.934403 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.934406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:55.934639 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:55.934437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.035586 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.035550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkt5q\" (UniqueName: \"kubernetes.io/projected/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-kube-api-access-mkt5q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.035586 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.035589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.035833 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.035647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.035912 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.035897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.035953 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.035939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.046472 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.046438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkt5q\" (UniqueName: \"kubernetes.io/projected/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-kube-api-access-mkt5q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.171708 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.171607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:46:56.313722 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.313692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn"] Jul 13 19:46:56.325783 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:46:56.325757 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fb95c3_9a1c_470c_8f44_1a64f6b9dbac.slice/crio-3621dd11d8ae55b72a6bb4b9f9a9c7cbd649ab3aae58674ec6c4c6026be3cdf3 WatchSource:0}: Error finding container 3621dd11d8ae55b72a6bb4b9f9a9c7cbd649ab3aae58674ec6c4c6026be3cdf3: Status 404 returned error can't find the container with id 3621dd11d8ae55b72a6bb4b9f9a9c7cbd649ab3aae58674ec6c4c6026be3cdf3 Jul 13 19:46:56.393952 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.393915 2576 generic.go:356] "Generic (PLEG): container finished" podID="34c149d0-9478-4589-863a-42a509b04e0e" containerID="3f8be5fe86e424ad2c3881b8fdcd75776d898993550a6d733040548bcc8e564f" exitCode=0 Jul 13 19:46:56.394110 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.393952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" event={"ID":"34c149d0-9478-4589-863a-42a509b04e0e","Type":"ContainerDied","Data":"3f8be5fe86e424ad2c3881b8fdcd75776d898993550a6d733040548bcc8e564f"} Jul 13 19:46:56.395809 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.395786 2576 generic.go:356] "Generic (PLEG): container finished" podID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerID="6f86264f0bff3549c0c511510565ac464b7d866c0ddb91b5d8d199e8ee0d9c2b" exitCode=0 Jul 13 19:46:56.395920 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.395874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" event={"ID":"76dca588-cf79-42ce-a8ea-5cf81e8e4153","Type":"ContainerDied","Data":"6f86264f0bff3549c0c511510565ac464b7d866c0ddb91b5d8d199e8ee0d9c2b"} Jul 13 19:46:56.395972 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.395939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" event={"ID":"76dca588-cf79-42ce-a8ea-5cf81e8e4153","Type":"ContainerStarted","Data":"ff9c5c5c249e9e972b960c33f6837fa13c10e18773a2ea818382c17155978c18"} Jul 13 19:46:56.397952 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.397663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" event={"ID":"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac","Type":"ContainerStarted","Data":"530098741bbb3439eb7367e2630f3e745e7ed7bbf096599df902c962d4157608"} Jul 13 19:46:56.397952 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.397746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" event={"ID":"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac","Type":"ContainerStarted","Data":"3621dd11d8ae55b72a6bb4b9f9a9c7cbd649ab3aae58674ec6c4c6026be3cdf3"} Jul 13 19:46:56.399708 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:56.399686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" event={"ID":"0e30beee-69f7-4961-8a66-e45302f7d340","Type":"ContainerStarted","Data":"eb5e5afcbd8f13c7c290fbc94ccd944191ebda5226ffb1e44e8e6f476b36be93"} Jul 13 19:46:57.406398 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:57.406359 2576 generic.go:356] "Generic (PLEG): container finished" podID="34c149d0-9478-4589-863a-42a509b04e0e" containerID="1550d8d782ae95cb61e9242e6c7278399bfc47cb84327ebc8b838eed5263c4dc" exitCode=0 Jul 13 19:46:57.406855 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:57.406450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" event={"ID":"34c149d0-9478-4589-863a-42a509b04e0e","Type":"ContainerDied","Data":"1550d8d782ae95cb61e9242e6c7278399bfc47cb84327ebc8b838eed5263c4dc"} Jul 13 19:46:57.408075 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:57.408016 2576 generic.go:356] "Generic (PLEG): container finished" podID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerID="530098741bbb3439eb7367e2630f3e745e7ed7bbf096599df902c962d4157608" exitCode=0 Jul 13 19:46:57.408157 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:57.408070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" event={"ID":"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac","Type":"ContainerDied","Data":"530098741bbb3439eb7367e2630f3e745e7ed7bbf096599df902c962d4157608"} Jul 13 19:46:57.409986 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:57.409945 2576 generic.go:356] "Generic (PLEG): container finished" podID="0e30beee-69f7-4961-8a66-e45302f7d340" containerID="eb5e5afcbd8f13c7c290fbc94ccd944191ebda5226ffb1e44e8e6f476b36be93" exitCode=0 Jul 13 19:46:57.409986 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:57.409982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" event={"ID":"0e30beee-69f7-4961-8a66-e45302f7d340","Type":"ContainerDied","Data":"eb5e5afcbd8f13c7c290fbc94ccd944191ebda5226ffb1e44e8e6f476b36be93"} Jul 13 19:46:58.417279 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:58.417221 2576 generic.go:356] "Generic (PLEG): container finished" podID="0e30beee-69f7-4961-8a66-e45302f7d340" containerID="4aada4013868e9612275d85fd72287d33909205a095b016afba265f15c541f69" exitCode=0 Jul 13 19:46:58.417766 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:58.417301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" event={"ID":"0e30beee-69f7-4961-8a66-e45302f7d340","Type":"ContainerDied","Data":"4aada4013868e9612275d85fd72287d33909205a095b016afba265f15c541f69"} Jul 13 19:46:58.419486 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:58.419458 2576 generic.go:356] "Generic (PLEG): container finished" podID="34c149d0-9478-4589-863a-42a509b04e0e" containerID="dc0a706d2b64ed2c7261b7b43ebdf663ee5b33836d400ac15ab2ef11ff21704b" exitCode=0 Jul 13 19:46:58.419604 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:58.419531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" event={"ID":"34c149d0-9478-4589-863a-42a509b04e0e","Type":"ContainerDied","Data":"dc0a706d2b64ed2c7261b7b43ebdf663ee5b33836d400ac15ab2ef11ff21704b"} Jul 13 19:46:58.421359 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:58.421328 2576 generic.go:356] "Generic (PLEG): container finished" podID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerID="49e1afef49a1099dbb42b3f921839b38a2bbf1ec8ce5aeb83cc0cb90eaaae6c5" exitCode=0 Jul 13 19:46:58.421449 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:58.421413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" event={"ID":"76dca588-cf79-42ce-a8ea-5cf81e8e4153","Type":"ContainerDied","Data":"49e1afef49a1099dbb42b3f921839b38a2bbf1ec8ce5aeb83cc0cb90eaaae6c5"} Jul 13 19:46:59.429237 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.429200 2576 generic.go:356] "Generic (PLEG): container finished" podID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerID="66a114f6275939c5f5718c2243c17415ab6b08da4104c42ff2cfe85072f7784b" exitCode=0 Jul 13 19:46:59.429722 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.429295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" event={"ID":"76dca588-cf79-42ce-a8ea-5cf81e8e4153","Type":"ContainerDied","Data":"66a114f6275939c5f5718c2243c17415ab6b08da4104c42ff2cfe85072f7784b"} Jul 13 19:46:59.431009 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.430985 2576 generic.go:356] "Generic (PLEG): container finished" podID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerID="b4750532c7dc00c1f004a60b2aab51d95c51c7128adff0541b8931b0ca71fcf0" exitCode=0 Jul 13 19:46:59.431113 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.431069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" event={"ID":"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac","Type":"ContainerDied","Data":"b4750532c7dc00c1f004a60b2aab51d95c51c7128adff0541b8931b0ca71fcf0"} Jul 13 19:46:59.591056 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.591027 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:46:59.660518 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.660489 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:46:59.762687 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.762652 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrhw\" (UniqueName: \"kubernetes.io/projected/34c149d0-9478-4589-863a-42a509b04e0e-kube-api-access-hrrhw\") pod \"34c149d0-9478-4589-863a-42a509b04e0e\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " Jul 13 19:46:59.762833 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.762699 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-bundle\") pod \"0e30beee-69f7-4961-8a66-e45302f7d340\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " Jul 13 19:46:59.762833 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.762756 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p67h6\" (UniqueName: \"kubernetes.io/projected/0e30beee-69f7-4961-8a66-e45302f7d340-kube-api-access-p67h6\") pod \"0e30beee-69f7-4961-8a66-e45302f7d340\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " Jul 13 19:46:59.762833 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.762776 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-util\") pod \"34c149d0-9478-4589-863a-42a509b04e0e\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " Jul 13 19:46:59.762833 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.762828 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-bundle\") pod \"34c149d0-9478-4589-863a-42a509b04e0e\" (UID: \"34c149d0-9478-4589-863a-42a509b04e0e\") " Jul 13 19:46:59.763051 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.762913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-util\") pod \"0e30beee-69f7-4961-8a66-e45302f7d340\" (UID: \"0e30beee-69f7-4961-8a66-e45302f7d340\") " Jul 13 19:46:59.763445 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.763414 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-bundle" (OuterVolumeSpecName: "bundle") pod "34c149d0-9478-4589-863a-42a509b04e0e" (UID: "34c149d0-9478-4589-863a-42a509b04e0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:46:59.763760 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.763735 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-bundle" (OuterVolumeSpecName: "bundle") pod "0e30beee-69f7-4961-8a66-e45302f7d340" (UID: "0e30beee-69f7-4961-8a66-e45302f7d340"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:46:59.765105 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.765074 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e30beee-69f7-4961-8a66-e45302f7d340-kube-api-access-p67h6" (OuterVolumeSpecName: "kube-api-access-p67h6") pod "0e30beee-69f7-4961-8a66-e45302f7d340" (UID: "0e30beee-69f7-4961-8a66-e45302f7d340"). InnerVolumeSpecName "kube-api-access-p67h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:46:59.765197 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.765159 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c149d0-9478-4589-863a-42a509b04e0e-kube-api-access-hrrhw" (OuterVolumeSpecName: "kube-api-access-hrrhw") pod "34c149d0-9478-4589-863a-42a509b04e0e" (UID: "34c149d0-9478-4589-863a-42a509b04e0e"). InnerVolumeSpecName "kube-api-access-hrrhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:46:59.768133 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.768109 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-util" (OuterVolumeSpecName: "util") pod "34c149d0-9478-4589-863a-42a509b04e0e" (UID: "34c149d0-9478-4589-863a-42a509b04e0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:46:59.768610 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.768590 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-util" (OuterVolumeSpecName: "util") pod "0e30beee-69f7-4961-8a66-e45302f7d340" (UID: "0e30beee-69f7-4961-8a66-e45302f7d340"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:46:59.863688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.863636 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p67h6\" (UniqueName: \"kubernetes.io/projected/0e30beee-69f7-4961-8a66-e45302f7d340-kube-api-access-p67h6\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:46:59.863688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.863684 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:46:59.863688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.863697 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34c149d0-9478-4589-863a-42a509b04e0e-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:46:59.863688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.863704 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:46:59.863963 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.863713 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrhw\" (UniqueName: \"kubernetes.io/projected/34c149d0-9478-4589-863a-42a509b04e0e-kube-api-access-hrrhw\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:46:59.863963 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:46:59.863722 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e30beee-69f7-4961-8a66-e45302f7d340-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:00.438018 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.437991 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" Jul 13 19:47:00.438472 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.437988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw" event={"ID":"34c149d0-9478-4589-863a-42a509b04e0e","Type":"ContainerDied","Data":"f751c44b3d12aab50e32fefa27e762179b812c543d29a66debea6e549161eb25"} Jul 13 19:47:00.438472 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.438116 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f751c44b3d12aab50e32fefa27e762179b812c543d29a66debea6e549161eb25" Jul 13 19:47:00.440195 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.440164 2576 generic.go:356] "Generic (PLEG): container finished" podID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerID="6b44294cc01534b0e54ead8a296ebed26e02c82581f839c9eaf36813fc0ceeca" exitCode=0 Jul 13 19:47:00.440384 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.440208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" event={"ID":"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac","Type":"ContainerDied","Data":"6b44294cc01534b0e54ead8a296ebed26e02c82581f839c9eaf36813fc0ceeca"} Jul 13 19:47:00.442295 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.442277 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" Jul 13 19:47:00.442409 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.442288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v" event={"ID":"0e30beee-69f7-4961-8a66-e45302f7d340","Type":"ContainerDied","Data":"a019de9af66df0c331efea5f3df434feb987ed5b9396cb4a0078a068c3ceab4e"} Jul 13 19:47:00.442409 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.442327 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a019de9af66df0c331efea5f3df434feb987ed5b9396cb4a0078a068c3ceab4e" Jul 13 19:47:00.576064 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.576039 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:47:00.670236 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.670199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-util\") pod \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " Jul 13 19:47:00.670446 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.670298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6pl8\" (UniqueName: \"kubernetes.io/projected/76dca588-cf79-42ce-a8ea-5cf81e8e4153-kube-api-access-b6pl8\") pod \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " Jul 13 19:47:00.670446 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.670378 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-bundle\") pod \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\" (UID: \"76dca588-cf79-42ce-a8ea-5cf81e8e4153\") " Jul 13 19:47:00.670884 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.670857 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-bundle" (OuterVolumeSpecName: "bundle") pod "76dca588-cf79-42ce-a8ea-5cf81e8e4153" (UID: "76dca588-cf79-42ce-a8ea-5cf81e8e4153"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:47:00.672503 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.672483 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76dca588-cf79-42ce-a8ea-5cf81e8e4153-kube-api-access-b6pl8" (OuterVolumeSpecName: "kube-api-access-b6pl8") pod "76dca588-cf79-42ce-a8ea-5cf81e8e4153" (UID: "76dca588-cf79-42ce-a8ea-5cf81e8e4153"). InnerVolumeSpecName "kube-api-access-b6pl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:47:00.675763 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.675741 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-util" (OuterVolumeSpecName: "util") pod "76dca588-cf79-42ce-a8ea-5cf81e8e4153" (UID: "76dca588-cf79-42ce-a8ea-5cf81e8e4153"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:47:00.771116 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.771068 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6pl8\" (UniqueName: \"kubernetes.io/projected/76dca588-cf79-42ce-a8ea-5cf81e8e4153-kube-api-access-b6pl8\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:00.771116 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.771110 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:00.771116 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:00.771122 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76dca588-cf79-42ce-a8ea-5cf81e8e4153-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:01.449032 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.449001 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" Jul 13 19:47:01.449032 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.449020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm" event={"ID":"76dca588-cf79-42ce-a8ea-5cf81e8e4153","Type":"ContainerDied","Data":"ff9c5c5c249e9e972b960c33f6837fa13c10e18773a2ea818382c17155978c18"} Jul 13 19:47:01.449483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.449064 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff9c5c5c249e9e972b960c33f6837fa13c10e18773a2ea818382c17155978c18" Jul 13 19:47:01.585587 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.585560 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:47:01.677660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.677575 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-bundle\") pod \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " Jul 13 19:47:01.677660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.677611 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-util\") pod \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " Jul 13 19:47:01.677660 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.677653 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkt5q\" (UniqueName: \"kubernetes.io/projected/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-kube-api-access-mkt5q\") pod \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\" (UID: \"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac\") " Jul 13 19:47:01.678071 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.678047 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-bundle" (OuterVolumeSpecName: "bundle") pod "45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" (UID: "45fb95c3-9a1c-470c-8f44-1a64f6b9dbac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:47:01.679942 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.679917 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-kube-api-access-mkt5q" (OuterVolumeSpecName: "kube-api-access-mkt5q") pod "45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" (UID: "45fb95c3-9a1c-470c-8f44-1a64f6b9dbac"). InnerVolumeSpecName "kube-api-access-mkt5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:47:01.682575 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.682532 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-util" (OuterVolumeSpecName: "util") pod "45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" (UID: "45fb95c3-9a1c-470c-8f44-1a64f6b9dbac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:47:01.778654 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.778619 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:01.778654 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.778646 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-util\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:01.778654 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:01.778656 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkt5q\" (UniqueName: \"kubernetes.io/projected/45fb95c3-9a1c-470c-8f44-1a64f6b9dbac-kube-api-access-mkt5q\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:02.456135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:02.456101 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" Jul 13 19:47:02.456135 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:02.456124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn" event={"ID":"45fb95c3-9a1c-470c-8f44-1a64f6b9dbac","Type":"ContainerDied","Data":"3621dd11d8ae55b72a6bb4b9f9a9c7cbd649ab3aae58674ec6c4c6026be3cdf3"} Jul 13 19:47:02.456671 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:02.456168 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3621dd11d8ae55b72a6bb4b9f9a9c7cbd649ab3aae58674ec6c4c6026be3cdf3" Jul 13 19:47:04.725324 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:04.725282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:04.825379 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:04.825329 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:04.925780 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:04.925752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:05.476152 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:05.476104 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:05.581781 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:05.581751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:06.215177 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:06.215142 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:07.233723 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:07.233688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:11.287882 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.287845 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z"] Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288201 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="pull" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288212 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="pull" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288224 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="pull" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288229 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="pull" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288237 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="extract" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288242 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="extract" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288269 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="extract" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288277 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="extract" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288285 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="util" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288290 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="util" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288297 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="util" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288302 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="util" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288308 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="util" Jul 13 19:47:11.288304 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288315 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="util" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288333 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288360 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288367 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288381 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="pull" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288387 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="pull" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288394 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="util" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288398 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="util" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288404 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="pull" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288410 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="pull" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288463 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c149d0-9478-4589-863a-42a509b04e0e" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288476 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45fb95c3-9a1c-470c-8f44-1a64f6b9dbac" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288486 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e30beee-69f7-4961-8a66-e45302f7d340" containerName="extract" Jul 13 19:47:11.288918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.288493 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="76dca588-cf79-42ce-a8ea-5cf81e8e4153" containerName="extract" Jul 13 19:47:11.292925 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.292909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:11.295598 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.295574 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 19:47:11.296486 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.296465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-r7bhs\"" Jul 13 19:47:11.296604 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.296471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 19:47:11.303805 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.303778 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z"] Jul 13 19:47:11.363868 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.363835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8jxb\" (UniqueName: \"kubernetes.io/projected/c04bac81-72f2-4722-a770-8bc7cb460569-kube-api-access-m8jxb\") pod \"authorino-operator-75cc8d5cb7-dlh2z\" (UID: \"c04bac81-72f2-4722-a770-8bc7cb460569\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:11.464920 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.464863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8jxb\" (UniqueName: \"kubernetes.io/projected/c04bac81-72f2-4722-a770-8bc7cb460569-kube-api-access-m8jxb\") pod \"authorino-operator-75cc8d5cb7-dlh2z\" (UID: \"c04bac81-72f2-4722-a770-8bc7cb460569\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:11.473743 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.473709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8jxb\" (UniqueName: \"kubernetes.io/projected/c04bac81-72f2-4722-a770-8bc7cb460569-kube-api-access-m8jxb\") pod \"authorino-operator-75cc8d5cb7-dlh2z\" (UID: \"c04bac81-72f2-4722-a770-8bc7cb460569\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:11.603989 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.603897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:11.747456 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:11.747430 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z"] Jul 13 19:47:11.750369 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:47:11.750339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04bac81_72f2_4722_a770_8bc7cb460569.slice/crio-75599999088e8c60a4ac91c0d94925778c263bb823aaeb3d0b1e6303405c321b WatchSource:0}: Error finding container 75599999088e8c60a4ac91c0d94925778c263bb823aaeb3d0b1e6303405c321b: Status 404 returned error can't find the container with id 75599999088e8c60a4ac91c0d94925778c263bb823aaeb3d0b1e6303405c321b Jul 13 19:47:12.492005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:12.491961 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:12.512664 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:12.512620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" event={"ID":"c04bac81-72f2-4722-a770-8bc7cb460569","Type":"ContainerStarted","Data":"75599999088e8c60a4ac91c0d94925778c263bb823aaeb3d0b1e6303405c321b"} Jul 13 19:47:14.525857 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:14.525820 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" event={"ID":"c04bac81-72f2-4722-a770-8bc7cb460569","Type":"ContainerStarted","Data":"bf233e09d8ca436e9b2c72edd944fbd8a1b3fe8a849e963497595829421d17f4"} Jul 13 19:47:14.526357 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:14.525951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:14.544002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:14.543955 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" podStartSLOduration=1.258279269 podStartE2EDuration="3.543938466s" totalImagesPullingTime="2.285659197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:47:14.543146954 +0000 UTC m=+423.655342009" watchObservedRunningTime="2026-07-13 19:47:14.543938466 +0000 UTC m=+423.656133516" Jul 13 19:47:15.471750 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:15.471695 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7bbfb5d5-v77zs"] Jul 13 19:47:15.577188 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:15.577151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:15.677445 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:15.677410 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:15.778182 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:15.778089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:16.079148 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:16.079054 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:19.058236 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:19.058190 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:19.151286 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:19.151229 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:20.195366 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:20.195322 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:21.825451 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:21.825414 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p"] Jul 13 19:47:21.832768 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:21.832741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:21.835263 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:21.835232 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 19:47:21.835398 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:21.835265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8h8wb\"" Jul 13 19:47:21.842576 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:21.842547 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p"] Jul 13 19:47:21.962819 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:21.962775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwmp6\" (UniqueName: \"kubernetes.io/projected/fdbe6c5b-66fc-431c-82c3-22695d1ad92a-kube-api-access-kwmp6\") pod \"dns-operator-controller-manager-864dd78c4c-dxv7p\" (UID: \"fdbe6c5b-66fc-431c-82c3-22695d1ad92a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:22.063817 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:22.063782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwmp6\" (UniqueName: \"kubernetes.io/projected/fdbe6c5b-66fc-431c-82c3-22695d1ad92a-kube-api-access-kwmp6\") pod \"dns-operator-controller-manager-864dd78c4c-dxv7p\" (UID: \"fdbe6c5b-66fc-431c-82c3-22695d1ad92a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:22.073397 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:22.073362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwmp6\" (UniqueName: \"kubernetes.io/projected/fdbe6c5b-66fc-431c-82c3-22695d1ad92a-kube-api-access-kwmp6\") pod \"dns-operator-controller-manager-864dd78c4c-dxv7p\" (UID: \"fdbe6c5b-66fc-431c-82c3-22695d1ad92a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:22.144410 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:22.144317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:22.322401 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:22.322358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p"] Jul 13 19:47:22.323331 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:47:22.323303 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbe6c5b_66fc_431c_82c3_22695d1ad92a.slice/crio-99ebf062d64668b8a5d6122a594074cbf7cd96e054162b1f1dbc51be7c257766 WatchSource:0}: Error finding container 99ebf062d64668b8a5d6122a594074cbf7cd96e054162b1f1dbc51be7c257766: Status 404 returned error can't find the container with id 99ebf062d64668b8a5d6122a594074cbf7cd96e054162b1f1dbc51be7c257766 Jul 13 19:47:22.568955 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:22.568924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" event={"ID":"fdbe6c5b-66fc-431c-82c3-22695d1ad92a","Type":"ContainerStarted","Data":"99ebf062d64668b8a5d6122a594074cbf7cd96e054162b1f1dbc51be7c257766"} Jul 13 19:47:23.052753 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:23.052715 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:23.140145 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:23.140107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:25.242422 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.242385 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4"] Jul 13 19:47:25.245983 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.245958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:25.248529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.248509 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6bnfs\"" Jul 13 19:47:25.256788 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.256760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4"] Jul 13 19:47:25.392499 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.392460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lv7\" (UniqueName: \"kubernetes.io/projected/455b22d8-bb04-44ba-a8a9-9a40e9dcde11-kube-api-access-r7lv7\") pod \"limitador-operator-controller-manager-859d7b78bd-29db4\" (UID: \"455b22d8-bb04-44ba-a8a9-9a40e9dcde11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:25.493716 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.493622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lv7\" (UniqueName: \"kubernetes.io/projected/455b22d8-bb04-44ba-a8a9-9a40e9dcde11-kube-api-access-r7lv7\") pod \"limitador-operator-controller-manager-859d7b78bd-29db4\" (UID: \"455b22d8-bb04-44ba-a8a9-9a40e9dcde11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:25.504887 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.504858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lv7\" (UniqueName: \"kubernetes.io/projected/455b22d8-bb04-44ba-a8a9-9a40e9dcde11-kube-api-access-r7lv7\") pod \"limitador-operator-controller-manager-859d7b78bd-29db4\" (UID: \"455b22d8-bb04-44ba-a8a9-9a40e9dcde11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:25.534957 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.534918 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlh2z" Jul 13 19:47:25.557413 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.557380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:25.590345 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.590301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" event={"ID":"fdbe6c5b-66fc-431c-82c3-22695d1ad92a","Type":"ContainerStarted","Data":"845de7c587b51666042d35c59feb8d1e860b7069e25608ccb133ae3cf0e78047"} Jul 13 19:47:25.590545 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.590422 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:25.609645 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.609595 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" podStartSLOduration=2.180577687 podStartE2EDuration="4.609579649s" totalImagesPullingTime="2.429001962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:47:25.607529976 +0000 UTC m=+434.719725027" watchObservedRunningTime="2026-07-13 19:47:25.609579649 +0000 UTC m=+434.721774700" Jul 13 19:47:25.715795 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:25.715765 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4"] Jul 13 19:47:25.717442 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:47:25.717409 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455b22d8_bb04_44ba_a8a9_9a40e9dcde11.slice/crio-37ac207c0531e8fe6e03cb770e3739e67542abc3d3f6c38b8756e6c10edf4dec WatchSource:0}: Error finding container 37ac207c0531e8fe6e03cb770e3739e67542abc3d3f6c38b8756e6c10edf4dec: Status 404 returned error can't find the container with id 37ac207c0531e8fe6e03cb770e3739e67542abc3d3f6c38b8756e6c10edf4dec Jul 13 19:47:26.598682 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:26.598643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" event={"ID":"455b22d8-bb04-44ba-a8a9-9a40e9dcde11","Type":"ContainerStarted","Data":"37ac207c0531e8fe6e03cb770e3739e67542abc3d3f6c38b8756e6c10edf4dec"} Jul 13 19:47:27.235709 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:27.235676 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:27.515415 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:27.515331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:28.036699 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:28.036665 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:28.094670 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:28.094634 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:28.610720 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:28.610680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" event={"ID":"455b22d8-bb04-44ba-a8a9-9a40e9dcde11","Type":"ContainerStarted","Data":"3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834"} Jul 13 19:47:28.610897 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:28.610826 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:28.629085 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:28.629027 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" podStartSLOduration=1.687972624 podStartE2EDuration="3.629010208s" totalImagesPullingTime="1.941037584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:47:28.627712309 +0000 UTC m=+437.739907355" watchObservedRunningTime="2026-07-13 19:47:28.629010208 +0000 UTC m=+437.741205259" Jul 13 19:47:29.270755 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:29.270724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:29.392648 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:29.392605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:30.318853 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:30.318822 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:34.440057 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:34.439954 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:34.539744 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:34.539703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:36.601026 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:36.600993 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dxv7p" Jul 13 19:47:37.373736 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.373702 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4"] Jul 13 19:47:37.374046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.374015 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" containerName="manager" containerID="cri-o://3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834" gracePeriod=2 Jul 13 19:47:37.381680 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.381656 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.396951 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.396910 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"455b22d8-bb04-44ba-a8a9-9a40e9dcde11\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-29db4\": pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.397446 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.397425 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4"] Jul 13 19:47:37.399111 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.399078 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" is forbidden: User \"system:node:ip-10-0-138-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-30.ec2.internal' and this object" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.411875 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.411847 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt"] Jul 13 19:47:37.412196 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.412183 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" containerName="manager" Jul 13 19:47:37.412196 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.412197 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" containerName="manager" Jul 13 19:47:37.412330 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.412294 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" containerName="manager" Jul 13 19:47:37.415454 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.415431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:37.429107 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.429084 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt"] Jul 13 19:47:37.452987 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.452954 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" is forbidden: User \"system:node:ip-10-0-138-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-30.ec2.internal' and this object" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.506972 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.506942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzw6p\" (UniqueName: \"kubernetes.io/projected/efe0561c-ecf9-4fdf-a5ee-799a9de5b282-kube-api-access-pzw6p\") pod \"limitador-operator-controller-manager-859d7b78bd-9xlwt\" (UID: \"efe0561c-ecf9-4fdf-a5ee-799a9de5b282\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:37.607748 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.607716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzw6p\" (UniqueName: \"kubernetes.io/projected/efe0561c-ecf9-4fdf-a5ee-799a9de5b282-kube-api-access-pzw6p\") pod \"limitador-operator-controller-manager-859d7b78bd-9xlwt\" (UID: \"efe0561c-ecf9-4fdf-a5ee-799a9de5b282\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:37.628538 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.628467 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.628891 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.628874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzw6p\" (UniqueName: \"kubernetes.io/projected/efe0561c-ecf9-4fdf-a5ee-799a9de5b282-kube-api-access-pzw6p\") pod \"limitador-operator-controller-manager-859d7b78bd-9xlwt\" (UID: \"efe0561c-ecf9-4fdf-a5ee-799a9de5b282\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:37.631068 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.631033 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" is forbidden: User \"system:node:ip-10-0-138-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-30.ec2.internal' and this object" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.660076 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.660042 2576 generic.go:356] "Generic (PLEG): container finished" podID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" containerID="3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834" exitCode=0 Jul 13 19:47:37.660259 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.660093 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.660259 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.660111 2576 scope.go:117] "RemoveContainer" containerID="3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834" Jul 13 19:47:37.666722 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.666694 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" is forbidden: User \"system:node:ip-10-0-138-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-30.ec2.internal' and this object" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:37.669299 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.669272 2576 scope.go:117] "RemoveContainer" containerID="3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834" Jul 13 19:47:37.669564 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.669545 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834\": container with ID starting with 3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834 not found: ID does not exist" containerID="3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834" Jul 13 19:47:37.669617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.669573 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834"} err="failed to get container status \"3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834\": rpc error: code = NotFound desc = could not find container \"3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834\": container with ID starting with 3f1f97a58e5063d95acb8948fce10132d5253b7d253137c9fac313e79c604834 not found: ID does not exist" Jul 13 19:47:37.757017 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.756983 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:37.810229 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.810170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7lv7\" (UniqueName: \"kubernetes.io/projected/455b22d8-bb04-44ba-a8a9-9a40e9dcde11-kube-api-access-r7lv7\") pod \"455b22d8-bb04-44ba-a8a9-9a40e9dcde11\" (UID: \"455b22d8-bb04-44ba-a8a9-9a40e9dcde11\") " Jul 13 19:47:37.812656 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.812616 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455b22d8-bb04-44ba-a8a9-9a40e9dcde11-kube-api-access-r7lv7" (OuterVolumeSpecName: "kube-api-access-r7lv7") pod "455b22d8-bb04-44ba-a8a9-9a40e9dcde11" (UID: "455b22d8-bb04-44ba-a8a9-9a40e9dcde11"). InnerVolumeSpecName "kube-api-access-r7lv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:47:37.908650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.908625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt"] Jul 13 19:47:37.910915 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:37.910894 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7lv7\" (UniqueName: \"kubernetes.io/projected/455b22d8-bb04-44ba-a8a9-9a40e9dcde11-kube-api-access-r7lv7\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:37.911022 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:47:37.910959 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe0561c_ecf9_4fdf_a5ee_799a9de5b282.slice/crio-64a0f0cce0e4a53f17924a78a85c7f7b4b7a7efd3107d7b996ead039f9ed15ff WatchSource:0}: Error finding container 64a0f0cce0e4a53f17924a78a85c7f7b4b7a7efd3107d7b996ead039f9ed15ff: Status 404 returned error can't find the container with id 64a0f0cce0e4a53f17924a78a85c7f7b4b7a7efd3107d7b996ead039f9ed15ff Jul 13 19:47:37.970521 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:37.970488 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" is forbidden: User \"system:node:ip-10-0-138-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-30.ec2.internal' and this object" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:38.673628 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:38.673534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" event={"ID":"efe0561c-ecf9-4fdf-a5ee-799a9de5b282","Type":"ContainerStarted","Data":"5fb912d898ff7113723d4910a7c5837f9f3d50c7e74bb679da5016e582cdf866"} Jul 13 19:47:38.673981 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:38.673630 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:38.673981 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:38.673647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" event={"ID":"efe0561c-ecf9-4fdf-a5ee-799a9de5b282","Type":"ContainerStarted","Data":"64a0f0cce0e4a53f17924a78a85c7f7b4b7a7efd3107d7b996ead039f9ed15ff"} Jul 13 19:47:38.699118 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:38.699047 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" podStartSLOduration=1.699026884 podStartE2EDuration="1.699026884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:47:38.697940726 +0000 UTC m=+447.810135769" watchObservedRunningTime="2026-07-13 19:47:38.699026884 +0000 UTC m=+447.811221936" Jul 13 19:47:38.699896 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:47:38.699856 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-29db4\" is forbidden: User \"system:node:ip-10-0-138-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-30.ec2.internal' and this object" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-29db4" Jul 13 19:47:39.379786 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:39.379751 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="455b22d8-bb04-44ba-a8a9-9a40e9dcde11" path="/var/lib/kubelet/pods/455b22d8-bb04-44ba-a8a9-9a40e9dcde11/volumes" Jul 13 19:47:40.499269 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.499222 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b7bbfb5d5-v77zs" podUID="891f2f50-3555-41ae-bf5e-4c2730eb9cbe" containerName="console" containerID="cri-o://aefa97b3c74fa3d80a93b3529312e61168f9650cf063f540998eeb9f3f417945" gracePeriod=15 Jul 13 19:47:40.686524 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.686493 2576 generic.go:356] "Generic (PLEG): container finished" podID="891f2f50-3555-41ae-bf5e-4c2730eb9cbe" containerID="aefa97b3c74fa3d80a93b3529312e61168f9650cf063f540998eeb9f3f417945" exitCode=0 Jul 13 19:47:40.686685 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.686561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7bbfb5d5-v77zs" event={"ID":"891f2f50-3555-41ae-bf5e-4c2730eb9cbe","Type":"ContainerDied","Data":"aefa97b3c74fa3d80a93b3529312e61168f9650cf063f540998eeb9f3f417945"} Jul 13 19:47:40.746606 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.746569 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:47:40.834561 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834467 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-oauth-serving-cert\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.834561 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834513 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-trusted-ca-bundle\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.834561 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834531 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-oauth-config\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.834862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834607 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-config\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.834862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834654 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-serving-cert\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.834862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834689 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5978r\" (UniqueName: \"kubernetes.io/projected/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-kube-api-access-5978r\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.834862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834719 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-service-ca\") pod \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\" (UID: \"891f2f50-3555-41ae-bf5e-4c2730eb9cbe\") " Jul 13 19:47:40.835077 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.834942 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:47:40.835140 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.835056 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:47:40.835221 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.835190 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-config" (OuterVolumeSpecName: "console-config") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:47:40.835350 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.835220 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-service-ca" (OuterVolumeSpecName: "service-ca") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:47:40.836925 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.836906 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:47:40.836987 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.836940 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:47:40.837046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.837026 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-kube-api-access-5978r" (OuterVolumeSpecName: "kube-api-access-5978r") pod "891f2f50-3555-41ae-bf5e-4c2730eb9cbe" (UID: "891f2f50-3555-41ae-bf5e-4c2730eb9cbe"). InnerVolumeSpecName "kube-api-access-5978r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:47:40.935665 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935625 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-serving-cert\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:40.935665 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935658 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5978r\" (UniqueName: \"kubernetes.io/projected/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-kube-api-access-5978r\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:40.935665 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935669 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-service-ca\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:40.935903 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935678 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-oauth-serving-cert\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:40.935903 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935689 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-trusted-ca-bundle\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:40.935903 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935697 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-oauth-config\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:40.935903 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:40.935705 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/891f2f50-3555-41ae-bf5e-4c2730eb9cbe-console-config\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:47:41.693984 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:41.693904 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7bbfb5d5-v77zs" Jul 13 19:47:41.693984 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:41.693931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7bbfb5d5-v77zs" event={"ID":"891f2f50-3555-41ae-bf5e-4c2730eb9cbe","Type":"ContainerDied","Data":"15fac48383973e920165c43716c024cefaafd9401b5bb8014c92c9b4ddae0857"} Jul 13 19:47:41.693984 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:41.693983 2576 scope.go:117] "RemoveContainer" containerID="aefa97b3c74fa3d80a93b3529312e61168f9650cf063f540998eeb9f3f417945" Jul 13 19:47:41.712855 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:41.712830 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7bbfb5d5-v77zs"] Jul 13 19:47:41.719985 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:41.719958 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b7bbfb5d5-v77zs"] Jul 13 19:47:42.651296 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:42.651239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:42.719842 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:42.719812 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:43.380871 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:43.380839 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="891f2f50-3555-41ae-bf5e-4c2730eb9cbe" path="/var/lib/kubelet/pods/891f2f50-3555-41ae-bf5e-4c2730eb9cbe/volumes" Jul 13 19:47:47.034456 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:47.034416 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:47.110684 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:47.110655 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:49.681120 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:49.681081 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xlwt" Jul 13 19:47:50.868779 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:50.868739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:50.979022 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:50.978978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:51.425286 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:51.425229 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:51.506332 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:51.506294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:57.436122 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:57.436083 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:47:57.657582 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:47:57.657545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:04.589560 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:04.589517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:04.689286 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:04.689230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:06.029096 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:06.029057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:06.201410 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:06.201362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:06.429672 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:06.429578 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:06.529645 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:06.529594 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:07.856562 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.856525 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:07.856978 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.856918 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891f2f50-3555-41ae-bf5e-4c2730eb9cbe" containerName="console" Jul 13 19:48:07.856978 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.856934 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="891f2f50-3555-41ae-bf5e-4c2730eb9cbe" containerName="console" Jul 13 19:48:07.857056 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.857015 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="891f2f50-3555-41ae-bf5e-4c2730eb9cbe" containerName="console" Jul 13 19:48:07.860201 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.860181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:07.862732 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.862706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 19:48:07.862732 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.862714 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5kz64\"" Jul 13 19:48:07.868095 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.868067 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:07.911535 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.911498 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:07.950064 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.950025 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:07.970211 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.970173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed3f4ba7-20eb-469f-9de3-be76968ffae4-config-file\") pod \"limitador-limitador-64c94fd64f-mnq4z\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:07.970400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:07.970241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxqb\" (UniqueName: \"kubernetes.io/projected/ed3f4ba7-20eb-469f-9de3-be76968ffae4-kube-api-access-7gxqb\") pod \"limitador-limitador-64c94fd64f-mnq4z\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:08.008529 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.008498 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:08.071527 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.071484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxqb\" (UniqueName: \"kubernetes.io/projected/ed3f4ba7-20eb-469f-9de3-be76968ffae4-kube-api-access-7gxqb\") pod \"limitador-limitador-64c94fd64f-mnq4z\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:08.071715 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.071586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed3f4ba7-20eb-469f-9de3-be76968ffae4-config-file\") pod \"limitador-limitador-64c94fd64f-mnq4z\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:08.072564 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.072543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed3f4ba7-20eb-469f-9de3-be76968ffae4-config-file\") pod \"limitador-limitador-64c94fd64f-mnq4z\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:08.080989 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.080967 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxqb\" (UniqueName: \"kubernetes.io/projected/ed3f4ba7-20eb-469f-9de3-be76968ffae4-kube-api-access-7gxqb\") pod \"limitador-limitador-64c94fd64f-mnq4z\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:08.172049 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.171950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:08.315142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.315115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:08.316993 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:48:08.316968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3f4ba7_20eb_469f_9de3_be76968ffae4.slice/crio-6139427f20ace757afa17914b5f4c3c9b83c50c24f0780d949a310ad8ff8e4d9 WatchSource:0}: Error finding container 6139427f20ace757afa17914b5f4c3c9b83c50c24f0780d949a310ad8ff8e4d9: Status 404 returned error can't find the container with id 6139427f20ace757afa17914b5f4c3c9b83c50c24f0780d949a310ad8ff8e4d9 Jul 13 19:48:08.691122 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.691084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:08.792417 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.792375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:08.846641 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:08.846604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" event={"ID":"ed3f4ba7-20eb-469f-9de3-be76968ffae4","Type":"ContainerStarted","Data":"6139427f20ace757afa17914b5f4c3c9b83c50c24f0780d949a310ad8ff8e4d9"} Jul 13 19:48:10.233729 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:10.233691 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:10.332614 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:10.332576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:11.865639 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:11.865600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" event={"ID":"ed3f4ba7-20eb-469f-9de3-be76968ffae4","Type":"ContainerStarted","Data":"ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4"} Jul 13 19:48:11.866053 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:11.865706 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:11.885260 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:11.885168 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" podStartSLOduration=2.135469115 podStartE2EDuration="4.885144313s" totalImagesPullingTime="2.749675198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:48:11.881463618 +0000 UTC m=+480.993658659" watchObservedRunningTime="2026-07-13 19:48:11.885144313 +0000 UTC m=+480.997339365" Jul 13 19:48:19.625808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:19.625771 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:19.679550 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:19.679493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:22.763011 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:22.762974 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:22.763612 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:22.763217 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" podUID="ed3f4ba7-20eb-469f-9de3-be76968ffae4" containerName="limitador" containerID="cri-o://ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4" gracePeriod=30 Jul 13 19:48:22.763992 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:22.763907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:23.312494 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.312466 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:23.409942 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.409848 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gxqb\" (UniqueName: \"kubernetes.io/projected/ed3f4ba7-20eb-469f-9de3-be76968ffae4-kube-api-access-7gxqb\") pod \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " Jul 13 19:48:23.409942 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.409930 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed3f4ba7-20eb-469f-9de3-be76968ffae4-config-file\") pod \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\" (UID: \"ed3f4ba7-20eb-469f-9de3-be76968ffae4\") " Jul 13 19:48:23.410346 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.410319 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3f4ba7-20eb-469f-9de3-be76968ffae4-config-file" (OuterVolumeSpecName: "config-file") pod "ed3f4ba7-20eb-469f-9de3-be76968ffae4" (UID: "ed3f4ba7-20eb-469f-9de3-be76968ffae4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:48:23.412065 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.412039 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3f4ba7-20eb-469f-9de3-be76968ffae4-kube-api-access-7gxqb" (OuterVolumeSpecName: "kube-api-access-7gxqb") pod "ed3f4ba7-20eb-469f-9de3-be76968ffae4" (UID: "ed3f4ba7-20eb-469f-9de3-be76968ffae4"). InnerVolumeSpecName "kube-api-access-7gxqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:48:23.510743 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.510705 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed3f4ba7-20eb-469f-9de3-be76968ffae4-config-file\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:48:23.510743 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.510735 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gxqb\" (UniqueName: \"kubernetes.io/projected/ed3f4ba7-20eb-469f-9de3-be76968ffae4-kube-api-access-7gxqb\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:48:23.932028 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.931997 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed3f4ba7-20eb-469f-9de3-be76968ffae4" containerID="ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4" exitCode=0 Jul 13 19:48:23.932525 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.932050 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" Jul 13 19:48:23.932525 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.932085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" event={"ID":"ed3f4ba7-20eb-469f-9de3-be76968ffae4","Type":"ContainerDied","Data":"ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4"} Jul 13 19:48:23.932525 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.932132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mnq4z" event={"ID":"ed3f4ba7-20eb-469f-9de3-be76968ffae4","Type":"ContainerDied","Data":"6139427f20ace757afa17914b5f4c3c9b83c50c24f0780d949a310ad8ff8e4d9"} Jul 13 19:48:23.932525 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.932165 2576 scope.go:117] "RemoveContainer" containerID="ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4" Jul 13 19:48:23.941918 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.941899 2576 scope.go:117] "RemoveContainer" containerID="ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4" Jul 13 19:48:23.942177 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:48:23.942157 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4\": container with ID starting with ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4 not found: ID does not exist" containerID="ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4" Jul 13 19:48:23.942216 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.942187 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4"} err="failed to get container status \"ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4\": rpc error: code = NotFound desc = could not find container \"ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4\": container with ID starting with ff76632b10bc552436a9d5c63ca5eae92ce8949bda637fae468da7d43efca5f4 not found: ID does not exist" Jul 13 19:48:23.958676 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.958645 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:23.964092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.964065 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mnq4z"] Jul 13 19:48:23.981799 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:23.981760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:24.079935 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.079901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:24.486464 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.486433 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq"] Jul 13 19:48:24.486793 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.486781 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3f4ba7-20eb-469f-9de3-be76968ffae4" containerName="limitador" Jul 13 19:48:24.486841 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.486795 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3f4ba7-20eb-469f-9de3-be76968ffae4" containerName="limitador" Jul 13 19:48:24.486884 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.486872 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed3f4ba7-20eb-469f-9de3-be76968ffae4" containerName="limitador" Jul 13 19:48:24.491133 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.491117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.494537 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.494516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 19:48:24.494698 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.494517 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 19:48:24.494771 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.494759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 13 19:48:24.495495 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.495481 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jcxmd\"" Jul 13 19:48:24.501805 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.501767 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq"] Jul 13 19:48:24.521497 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.521473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:24.620586 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.620555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b7499cac-28c8-4f6f-be18-847a4c75f10c-data\") pod \"postgres-69fb4594cf-8hdgq\" (UID: \"b7499cac-28c8-4f6f-be18-847a4c75f10c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.620759 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.620673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts9zd\" (UniqueName: \"kubernetes.io/projected/b7499cac-28c8-4f6f-be18-847a4c75f10c-kube-api-access-ts9zd\") pod \"postgres-69fb4594cf-8hdgq\" (UID: \"b7499cac-28c8-4f6f-be18-847a4c75f10c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.721718 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.721677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts9zd\" (UniqueName: \"kubernetes.io/projected/b7499cac-28c8-4f6f-be18-847a4c75f10c-kube-api-access-ts9zd\") pod \"postgres-69fb4594cf-8hdgq\" (UID: \"b7499cac-28c8-4f6f-be18-847a4c75f10c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.721880 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.721730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b7499cac-28c8-4f6f-be18-847a4c75f10c-data\") pod \"postgres-69fb4594cf-8hdgq\" (UID: \"b7499cac-28c8-4f6f-be18-847a4c75f10c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.722094 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.722076 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b7499cac-28c8-4f6f-be18-847a4c75f10c-data\") pod \"postgres-69fb4594cf-8hdgq\" (UID: \"b7499cac-28c8-4f6f-be18-847a4c75f10c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.730532 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.730501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts9zd\" (UniqueName: \"kubernetes.io/projected/b7499cac-28c8-4f6f-be18-847a4c75f10c-kube-api-access-ts9zd\") pod \"postgres-69fb4594cf-8hdgq\" (UID: \"b7499cac-28c8-4f6f-be18-847a4c75f10c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.802002 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.801910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:24.941231 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:24.941206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq"] Jul 13 19:48:24.944414 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:48:24.944389 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7499cac_28c8_4f6f_be18_847a4c75f10c.slice/crio-28a2579e88ebb363dbc9c31cb0f2c280169212dffc957420251ec91863a8e2fa WatchSource:0}: Error finding container 28a2579e88ebb363dbc9c31cb0f2c280169212dffc957420251ec91863a8e2fa: Status 404 returned error can't find the container with id 28a2579e88ebb363dbc9c31cb0f2c280169212dffc957420251ec91863a8e2fa Jul 13 19:48:25.385786 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:25.385750 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3f4ba7-20eb-469f-9de3-be76968ffae4" path="/var/lib/kubelet/pods/ed3f4ba7-20eb-469f-9de3-be76968ffae4/volumes" Jul 13 19:48:25.948858 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:25.948780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" event={"ID":"b7499cac-28c8-4f6f-be18-847a4c75f10c","Type":"ContainerStarted","Data":"28a2579e88ebb363dbc9c31cb0f2c280169212dffc957420251ec91863a8e2fa"} Jul 13 19:48:29.976477 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:29.976391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" event={"ID":"b7499cac-28c8-4f6f-be18-847a4c75f10c","Type":"ContainerStarted","Data":"3d25e78999581aaf7b2fa8ef53b82cd150d929a6b38dbfccae603615b41a6b05"} Jul 13 19:48:29.976847 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:29.976527 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:29.994342 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:29.994285 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" podStartSLOduration=1.217122306 podStartE2EDuration="5.994242832s" totalImagesPullingTime="4.777120526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:48:29.99275036 +0000 UTC m=+499.104945412" watchObservedRunningTime="2026-07-13 19:48:29.994242832 +0000 UTC m=+499.106437884" Jul 13 19:48:33.161724 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:33.161685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:36.013678 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:36.013651 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8hdgq" Jul 13 19:48:36.353413 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:36.353323 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:36.454766 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:36.454723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:43.033364 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.033324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:43.061825 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.061789 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c5f5f8fc9-pffxm"] Jul 13 19:48:43.087483 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.087454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5f5f8fc9-pffxm"] Jul 13 19:48:43.087639 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.087548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.091434 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.091409 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 19:48:43.091434 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.091421 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 19:48:43.092118 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.092098 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p9jt2\"" Jul 13 19:48:43.134017 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.133976 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:43.182928 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.182894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f881dad-9f9d-4838-970e-6e261f0ad545-webhook-cert\") pod \"maas-controller-6c5f5f8fc9-pffxm\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.183086 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.182962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76rc\" (UniqueName: \"kubernetes.io/projected/6f881dad-9f9d-4838-970e-6e261f0ad545-kube-api-access-g76rc\") pod \"maas-controller-6c5f5f8fc9-pffxm\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.192808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.192771 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:43.242302 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.242262 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-844b75fcd-fq67s"] Jul 13 19:48:43.245960 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.245939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.255819 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.255793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844b75fcd-fq67s"] Jul 13 19:48:43.283818 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.283738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/950f4154-b914-4ea4-88e9-c5f5e31f8be4-webhook-cert\") pod \"maas-controller-844b75fcd-fq67s\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.283818 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.283787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g76rc\" (UniqueName: \"kubernetes.io/projected/6f881dad-9f9d-4838-970e-6e261f0ad545-kube-api-access-g76rc\") pod \"maas-controller-6c5f5f8fc9-pffxm\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.284039 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.283844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6kfc\" (UniqueName: \"kubernetes.io/projected/950f4154-b914-4ea4-88e9-c5f5e31f8be4-kube-api-access-r6kfc\") pod \"maas-controller-844b75fcd-fq67s\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.284039 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.283909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f881dad-9f9d-4838-970e-6e261f0ad545-webhook-cert\") pod \"maas-controller-6c5f5f8fc9-pffxm\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.286356 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.286333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f881dad-9f9d-4838-970e-6e261f0ad545-webhook-cert\") pod \"maas-controller-6c5f5f8fc9-pffxm\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.292657 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.292626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76rc\" (UniqueName: \"kubernetes.io/projected/6f881dad-9f9d-4838-970e-6e261f0ad545-kube-api-access-g76rc\") pod \"maas-controller-6c5f5f8fc9-pffxm\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.304485 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.304451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:43.385365 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.385331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/950f4154-b914-4ea4-88e9-c5f5e31f8be4-webhook-cert\") pod \"maas-controller-844b75fcd-fq67s\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.385566 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.385387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6kfc\" (UniqueName: \"kubernetes.io/projected/950f4154-b914-4ea4-88e9-c5f5e31f8be4-kube-api-access-r6kfc\") pod \"maas-controller-844b75fcd-fq67s\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.387920 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.387897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/950f4154-b914-4ea4-88e9-c5f5e31f8be4-webhook-cert\") pod \"maas-controller-844b75fcd-fq67s\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.394217 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.394192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6kfc\" (UniqueName: \"kubernetes.io/projected/950f4154-b914-4ea4-88e9-c5f5e31f8be4-kube-api-access-r6kfc\") pod \"maas-controller-844b75fcd-fq67s\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.397990 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.397969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:43.535948 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.535917 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5f5f8fc9-pffxm"] Jul 13 19:48:43.537690 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:48:43.537659 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f881dad_9f9d_4838_970e_6e261f0ad545.slice/crio-0bb1059d30bf45d7b96f2915078594624d655a17dad7d7c039f890c04830091d WatchSource:0}: Error finding container 0bb1059d30bf45d7b96f2915078594624d655a17dad7d7c039f890c04830091d: Status 404 returned error can't find the container with id 0bb1059d30bf45d7b96f2915078594624d655a17dad7d7c039f890c04830091d Jul 13 19:48:43.557565 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.557538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:43.694294 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:43.694269 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844b75fcd-fq67s"] Jul 13 19:48:43.695608 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:48:43.695585 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950f4154_b914_4ea4_88e9_c5f5e31f8be4.slice/crio-4f92cffd61b581d4e84a6d93607a958364914184ab0747e6d225ac498d87673d WatchSource:0}: Error finding container 4f92cffd61b581d4e84a6d93607a958364914184ab0747e6d225ac498d87673d: Status 404 returned error can't find the container with id 4f92cffd61b581d4e84a6d93607a958364914184ab0747e6d225ac498d87673d Jul 13 19:48:44.063465 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:44.063425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b75fcd-fq67s" event={"ID":"950f4154-b914-4ea4-88e9-c5f5e31f8be4","Type":"ContainerStarted","Data":"4f92cffd61b581d4e84a6d93607a958364914184ab0747e6d225ac498d87673d"} Jul 13 19:48:44.064709 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:44.064683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" event={"ID":"6f881dad-9f9d-4838-970e-6e261f0ad545","Type":"ContainerStarted","Data":"0bb1059d30bf45d7b96f2915078594624d655a17dad7d7c039f890c04830091d"} Jul 13 19:48:46.264442 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:46.264404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:46.352730 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:46.352638 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:47.084618 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:47.084582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b75fcd-fq67s" event={"ID":"950f4154-b914-4ea4-88e9-c5f5e31f8be4","Type":"ContainerStarted","Data":"b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c"} Jul 13 19:48:47.084814 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:47.084658 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:47.086175 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:47.086148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" event={"ID":"6f881dad-9f9d-4838-970e-6e261f0ad545","Type":"ContainerStarted","Data":"752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833"} Jul 13 19:48:47.086308 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:47.086195 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:47.104940 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:47.104890 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-844b75fcd-fq67s" podStartSLOduration=1.740259937 podStartE2EDuration="4.104874871s" totalImagesPullingTime="2.364614934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:48:47.102850335 +0000 UTC m=+516.215045386" watchObservedRunningTime="2026-07-13 19:48:47.104874871 +0000 UTC m=+516.217069940" Jul 13 19:48:47.123567 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:47.123514 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" podStartSLOduration=1.6076282050000001 podStartE2EDuration="4.123498533s" totalImagesPullingTime="2.515870328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:48:47.121516826 +0000 UTC m=+516.233711878" watchObservedRunningTime="2026-07-13 19:48:47.123498533 +0000 UTC m=+516.235693608" Jul 13 19:48:58.098046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.098012 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:58.098538 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.098088 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:48:58.162083 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.162047 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c5f5f8fc9-pffxm"] Jul 13 19:48:58.162307 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.162279 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" podUID="6f881dad-9f9d-4838-970e-6e261f0ad545" containerName="manager" containerID="cri-o://752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833" gracePeriod=30 Jul 13 19:48:58.408750 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.408718 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:58.522224 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.522185 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f881dad-9f9d-4838-970e-6e261f0ad545-webhook-cert\") pod \"6f881dad-9f9d-4838-970e-6e261f0ad545\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " Jul 13 19:48:58.522440 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.522241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g76rc\" (UniqueName: \"kubernetes.io/projected/6f881dad-9f9d-4838-970e-6e261f0ad545-kube-api-access-g76rc\") pod \"6f881dad-9f9d-4838-970e-6e261f0ad545\" (UID: \"6f881dad-9f9d-4838-970e-6e261f0ad545\") " Jul 13 19:48:58.524686 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.524654 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f881dad-9f9d-4838-970e-6e261f0ad545-kube-api-access-g76rc" (OuterVolumeSpecName: "kube-api-access-g76rc") pod "6f881dad-9f9d-4838-970e-6e261f0ad545" (UID: "6f881dad-9f9d-4838-970e-6e261f0ad545"). InnerVolumeSpecName "kube-api-access-g76rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:48:58.524821 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.524648 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f881dad-9f9d-4838-970e-6e261f0ad545-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6f881dad-9f9d-4838-970e-6e261f0ad545" (UID: "6f881dad-9f9d-4838-970e-6e261f0ad545"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:48:58.622883 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.622850 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f881dad-9f9d-4838-970e-6e261f0ad545-webhook-cert\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:48:58.622883 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:58.622877 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g76rc\" (UniqueName: \"kubernetes.io/projected/6f881dad-9f9d-4838-970e-6e261f0ad545-kube-api-access-g76rc\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:48:59.161402 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.161357 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f881dad-9f9d-4838-970e-6e261f0ad545" containerID="752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833" exitCode=0 Jul 13 19:48:59.161899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.161440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" event={"ID":"6f881dad-9f9d-4838-970e-6e261f0ad545","Type":"ContainerDied","Data":"752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833"} Jul 13 19:48:59.161899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.161522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" event={"ID":"6f881dad-9f9d-4838-970e-6e261f0ad545","Type":"ContainerDied","Data":"0bb1059d30bf45d7b96f2915078594624d655a17dad7d7c039f890c04830091d"} Jul 13 19:48:59.161899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.161560 2576 scope.go:117] "RemoveContainer" containerID="752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833" Jul 13 19:48:59.161899 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.161767 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5f5f8fc9-pffxm" Jul 13 19:48:59.173274 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.173192 2576 scope.go:117] "RemoveContainer" containerID="752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833" Jul 13 19:48:59.173563 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:48:59.173542 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833\": container with ID starting with 752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833 not found: ID does not exist" containerID="752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833" Jul 13 19:48:59.173633 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.173578 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833"} err="failed to get container status \"752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833\": rpc error: code = NotFound desc = could not find container \"752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833\": container with ID starting with 752155db61b4ed2427a6db1ceb71766b798f42f48ea80d565bd79391f8f07833 not found: ID does not exist" Jul 13 19:48:59.187911 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.187871 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c5f5f8fc9-pffxm"] Jul 13 19:48:59.191966 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.191933 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c5f5f8fc9-pffxm"] Jul 13 19:48:59.380353 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:48:59.380309 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f881dad-9f9d-4838-970e-6e261f0ad545" path="/var/lib/kubelet/pods/6f881dad-9f9d-4838-970e-6e261f0ad545/volumes" Jul 13 19:49:19.513914 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:19.513845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:20.051231 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.051193 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:20.104423 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.104386 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn"] Jul 13 19:49:20.104791 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.104776 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f881dad-9f9d-4838-970e-6e261f0ad545" containerName="manager" Jul 13 19:49:20.104835 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.104795 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f881dad-9f9d-4838-970e-6e261f0ad545" containerName="manager" Jul 13 19:49:20.104889 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.104879 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f881dad-9f9d-4838-970e-6e261f0ad545" containerName="manager" Jul 13 19:49:20.111006 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.110983 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.114455 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.114434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z97rd\"" Jul 13 19:49:20.114586 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.114458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 13 19:49:20.118704 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.118680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqfb8\" (UniqueName: \"kubernetes.io/projected/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-kube-api-access-tqfb8\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.118866 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.118847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-openshift-service-ca\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.118921 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.118901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-maas-api-tls\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.123742 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.123721 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn"] Jul 13 19:49:20.137784 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.137749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:20.220137 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.220102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-openshift-service-ca\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.220345 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.220153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-maas-api-tls\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.220345 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.220192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqfb8\" (UniqueName: \"kubernetes.io/projected/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-kube-api-access-tqfb8\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.221105 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.221083 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-openshift-service-ca\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.228043 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.228011 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-maas-api-tls\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.229706 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.229681 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqfb8\" (UniqueName: \"kubernetes.io/projected/4b7ecc18-c4a7-4a63-9740-de3ca2867fcf-kube-api-access-tqfb8\") pod \"maas-api-6956f54f6b-sxkxn\" (UID: \"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf\") " pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.422700 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.422609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:20.505479 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.505409 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:20.587266 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.587222 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn"] Jul 13 19:49:20.606449 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:49:20.606418 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7ecc18_c4a7_4a63_9740_de3ca2867fcf.slice/crio-9b6a2e263f8b448bb2f0006789757cdd1bcb65d53fc1676abdd2439b283916f2 WatchSource:0}: Error finding container 9b6a2e263f8b448bb2f0006789757cdd1bcb65d53fc1676abdd2439b283916f2: Status 404 returned error can't find the container with id 9b6a2e263f8b448bb2f0006789757cdd1bcb65d53fc1676abdd2439b283916f2 Jul 13 19:49:20.620912 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.620884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:20.729202 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.729167 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8w22j"] Jul 13 19:49:20.735593 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.735566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:20.738046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.738016 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tf4l8\"" Jul 13 19:49:20.738046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.738031 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 19:49:20.747300 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.747232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8w22j"] Jul 13 19:49:20.826669 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.826634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds2v4\" (UniqueName: \"kubernetes.io/projected/3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc-kube-api-access-ds2v4\") pod \"payload-pre-processing-7964457696-8w22j\" (UID: \"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc\") " pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:20.826878 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.826706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8w22j\" (UID: \"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc\") " pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:20.927939 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.927898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds2v4\" (UniqueName: \"kubernetes.io/projected/3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc-kube-api-access-ds2v4\") pod \"payload-pre-processing-7964457696-8w22j\" (UID: \"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc\") " pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:20.928108 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.927972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8w22j\" (UID: \"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc\") " pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:20.928792 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.928772 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8w22j\" (UID: \"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc\") " pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:20.936636 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:20.936610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds2v4\" (UniqueName: \"kubernetes.io/projected/3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc-kube-api-access-ds2v4\") pod \"payload-pre-processing-7964457696-8w22j\" (UID: \"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc\") " pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:21.048400 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:21.048298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:21.188623 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:21.188599 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8w22j"] Jul 13 19:49:21.190174 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:49:21.190149 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf0d4d8_a1a7_41f5_bd31_b95c5689aafc.slice/crio-8b43e519fb520b306c58f3f275eef9d8ce457f4a88cb3b93ac7c4ff8e2c0b625 WatchSource:0}: Error finding container 8b43e519fb520b306c58f3f275eef9d8ce457f4a88cb3b93ac7c4ff8e2c0b625: Status 404 returned error can't find the container with id 8b43e519fb520b306c58f3f275eef9d8ce457f4a88cb3b93ac7c4ff8e2c0b625 Jul 13 19:49:21.287406 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:21.287367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" event={"ID":"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf","Type":"ContainerStarted","Data":"9b6a2e263f8b448bb2f0006789757cdd1bcb65d53fc1676abdd2439b283916f2"} Jul 13 19:49:21.288652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:21.288625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" event={"ID":"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc","Type":"ContainerStarted","Data":"8b43e519fb520b306c58f3f275eef9d8ce457f4a88cb3b93ac7c4ff8e2c0b625"} Jul 13 19:49:24.307518 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:24.307472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" event={"ID":"4b7ecc18-c4a7-4a63-9740-de3ca2867fcf","Type":"ContainerStarted","Data":"ad4cdbe544b9f85d04e167b9da6d921db1aff99654a03de67ef7d6e9c607f013"} Jul 13 19:49:24.308001 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:24.307549 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:24.309042 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:24.309018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" event={"ID":"3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc","Type":"ContainerStarted","Data":"66f80d75c908fa91e468d9dd7176d077749b61162e6d6ff1fe37e8ea1067636c"} Jul 13 19:49:24.309150 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:24.309073 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:24.325342 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:24.325288 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" podStartSLOduration=1.684636625 podStartE2EDuration="4.325272319s" totalImagesPullingTime="2.640635694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:49:24.323415136 +0000 UTC m=+553.435610186" watchObservedRunningTime="2026-07-13 19:49:24.325272319 +0000 UTC m=+553.437467366" Jul 13 19:49:24.340390 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:24.340336 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" podStartSLOduration=2.282243737 podStartE2EDuration="4.340318995s" totalImagesPullingTime="2.058075258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:49:24.337992019 +0000 UTC m=+553.450187085" watchObservedRunningTime="2026-07-13 19:49:24.340318995 +0000 UTC m=+553.452514078" Jul 13 19:49:30.320010 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:30.319978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6956f54f6b-sxkxn" Jul 13 19:49:30.493287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:30.493223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:30.548279 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:30.548214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:31.290896 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:31.290862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:31.386971 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:31.386937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:34.858370 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.858337 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7"] Jul 13 19:49:34.861818 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.861800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:34.864450 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.864424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 13 19:49:34.865525 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.865502 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 19:49:34.865652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.865529 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 19:49:34.865652 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.865593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bgcx2\"" Jul 13 19:49:34.870808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.870786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7"] Jul 13 19:49:34.961808 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.961775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5f26\" (UniqueName: \"kubernetes.io/projected/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-kube-api-access-b5f26\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:34.961987 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.961812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:34.961987 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.961913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:34.961987 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.961958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:34.961987 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.961977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:34.962129 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:34.961992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062460 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5f26\" (UniqueName: \"kubernetes.io/projected/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-kube-api-access-b5f26\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062650 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.062983 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.062962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.063048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.063006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.063048 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.063029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.065046 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.065021 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.065325 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.065298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.071350 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.071326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5f26\" (UniqueName: \"kubernetes.io/projected/f42dbbac-6ce3-471d-a196-e04a7ec8e7b3-kube-api-access-b5f26\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7\" (UID: \"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.173930 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.173837 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:35.228768 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.228719 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:35.316848 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.316823 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8w22j" Jul 13 19:49:35.322775 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.322754 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7"] Jul 13 19:49:35.325403 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:49:35.325375 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42dbbac_6ce3_471d_a196_e04a7ec8e7b3.slice/crio-d7a2f74db2c44c5cfb903e6fe19e3531e0ae067ed61f04463158dca6a7ef5a88 WatchSource:0}: Error finding container d7a2f74db2c44c5cfb903e6fe19e3531e0ae067ed61f04463158dca6a7ef5a88: Status 404 returned error can't find the container with id d7a2f74db2c44c5cfb903e6fe19e3531e0ae067ed61f04463158dca6a7ef5a88 Jul 13 19:49:35.382937 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:35.382878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" event={"ID":"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3","Type":"ContainerStarted","Data":"d7a2f74db2c44c5cfb903e6fe19e3531e0ae067ed61f04463158dca6a7ef5a88"} Jul 13 19:49:37.389150 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:37.389112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" event={"ID":"f42dbbac-6ce3-471d-a196-e04a7ec8e7b3","Type":"ContainerStarted","Data":"4db7e25f2e41fc274390769b7b4d7be236371ef42b5c5969751c3356b6256c4d"} Jul 13 19:49:37.408297 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:37.408229 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" podStartSLOduration=2.285951652 podStartE2EDuration="3.408214204s" totalImagesPullingTime="1.122262552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:49:37.405768994 +0000 UTC m=+566.517964039" watchObservedRunningTime="2026-07-13 19:49:37.408214204 +0000 UTC m=+566.520409254" Jul 13 19:49:45.174222 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:45.174177 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:45.174766 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:45.174310 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:45.186781 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:45.186744 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:45.446460 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:45.446382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7" Jul 13 19:49:48.076598 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:49:48.076566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:09.588923 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:09.588886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:11.296303 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:11.296275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:50:11.298663 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:11.298643 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:50:11.303389 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:11.303368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:50:11.306016 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:11.306000 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:50:19.742043 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.742009 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m"] Jul 13 19:50:19.745766 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.745750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.748580 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.748559 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 13 19:50:19.754287 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.754263 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m"] Jul 13 19:50:19.760764 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.760731 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:19.861235 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.861202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.861432 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.861240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.861432 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.861384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6kw\" (UniqueName: \"kubernetes.io/projected/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-kube-api-access-dr6kw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.861432 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.861417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.861540 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.861443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.861540 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.861481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962427 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6kw\" (UniqueName: \"kubernetes.io/projected/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-kube-api-access-dr6kw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962427 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962688 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962916 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962916 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.962992 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.962926 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.964939 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.964921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.965062 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.965044 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:19.972834 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:19.972797 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6kw\" (UniqueName: \"kubernetes.io/projected/e7984a29-80cc-4843-85dc-ec91a6ec9a7a-kube-api-access-dr6kw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m\" (UID: \"e7984a29-80cc-4843-85dc-ec91a6ec9a7a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:20.056524 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:20.056432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:20.196921 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:20.196895 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m"] Jul 13 19:50:20.198746 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:50:20.198719 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7984a29_80cc_4843_85dc_ec91a6ec9a7a.slice/crio-6b09009785c4ea31b7cc46f5222fc3d1fcdf82b728179907da5772ddbf82fa21 WatchSource:0}: Error finding container 6b09009785c4ea31b7cc46f5222fc3d1fcdf82b728179907da5772ddbf82fa21: Status 404 returned error can't find the container with id 6b09009785c4ea31b7cc46f5222fc3d1fcdf82b728179907da5772ddbf82fa21 Jul 13 19:50:20.200227 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:20.200205 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 19:50:20.630316 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:20.630279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" event={"ID":"e7984a29-80cc-4843-85dc-ec91a6ec9a7a","Type":"ContainerStarted","Data":"4998c94ce9a8ab35372baf1555e91965006460a69c10f9ac09b50629fec1d1e1"} Jul 13 19:50:20.630502 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:20.630349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" event={"ID":"e7984a29-80cc-4843-85dc-ec91a6ec9a7a","Type":"ContainerStarted","Data":"6b09009785c4ea31b7cc46f5222fc3d1fcdf82b728179907da5772ddbf82fa21"} Jul 13 19:50:20.650256 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:20.650205 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" podStartSLOduration=1.43580493 podStartE2EDuration="1.650188076s" totalImagesPullingTime="214.383146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:50:20.64778032 +0000 UTC m=+609.759975371" watchObservedRunningTime="2026-07-13 19:50:20.650188076 +0000 UTC m=+609.762383127" Jul 13 19:50:29.060703 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:29.060674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:30.057380 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:30.057342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:30.057571 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:30.057431 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:30.069846 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:30.069819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:30.703370 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:30.703340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m" Jul 13 19:50:41.415900 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:41.415805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:43.490092 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:50:43.490055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:33.388858 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:33.388820 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:50.895949 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:50.895912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:50.957345 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:50.957281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:55.192495 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:55.192455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:55.294491 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:55.294446 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:55.900612 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:55.900577 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:51:55.992547 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:51:55.992510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:52:05.469039 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:52:05.468945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:52:05.526785 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:52:05.526746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:05.907617 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:05.907581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:06.012504 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.012474 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-844b75fcd-fq67s"] Jul 13 19:53:06.012719 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.012691 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-844b75fcd-fq67s" podUID="950f4154-b914-4ea4-88e9-c5f5e31f8be4" containerName="manager" containerID="cri-o://b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c" gracePeriod=30 Jul 13 19:53:06.263966 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.263936 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:53:06.375330 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.375292 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/950f4154-b914-4ea4-88e9-c5f5e31f8be4-webhook-cert\") pod \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " Jul 13 19:53:06.375330 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.375332 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6kfc\" (UniqueName: \"kubernetes.io/projected/950f4154-b914-4ea4-88e9-c5f5e31f8be4-kube-api-access-r6kfc\") pod \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\" (UID: \"950f4154-b914-4ea4-88e9-c5f5e31f8be4\") " Jul 13 19:53:06.377536 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.377501 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950f4154-b914-4ea4-88e9-c5f5e31f8be4-kube-api-access-r6kfc" (OuterVolumeSpecName: "kube-api-access-r6kfc") pod "950f4154-b914-4ea4-88e9-c5f5e31f8be4" (UID: "950f4154-b914-4ea4-88e9-c5f5e31f8be4"). InnerVolumeSpecName "kube-api-access-r6kfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:53:06.377658 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.377576 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/950f4154-b914-4ea4-88e9-c5f5e31f8be4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "950f4154-b914-4ea4-88e9-c5f5e31f8be4" (UID: "950f4154-b914-4ea4-88e9-c5f5e31f8be4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 19:53:06.476924 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.476894 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/950f4154-b914-4ea4-88e9-c5f5e31f8be4-webhook-cert\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:53:06.476924 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.476921 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6kfc\" (UniqueName: \"kubernetes.io/projected/950f4154-b914-4ea4-88e9-c5f5e31f8be4-kube-api-access-r6kfc\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 19:53:06.572493 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.572461 2576 generic.go:356] "Generic (PLEG): container finished" podID="950f4154-b914-4ea4-88e9-c5f5e31f8be4" containerID="b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c" exitCode=0 Jul 13 19:53:06.572661 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.572507 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b75fcd-fq67s" Jul 13 19:53:06.572661 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.572537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b75fcd-fq67s" event={"ID":"950f4154-b914-4ea4-88e9-c5f5e31f8be4","Type":"ContainerDied","Data":"b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c"} Jul 13 19:53:06.572661 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.572588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b75fcd-fq67s" event={"ID":"950f4154-b914-4ea4-88e9-c5f5e31f8be4","Type":"ContainerDied","Data":"4f92cffd61b581d4e84a6d93607a958364914184ab0747e6d225ac498d87673d"} Jul 13 19:53:06.572661 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.572611 2576 scope.go:117] "RemoveContainer" containerID="b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c" Jul 13 19:53:06.582165 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.582141 2576 scope.go:117] "RemoveContainer" containerID="b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c" Jul 13 19:53:06.582455 ip-10-0-138-30 kubenswrapper[2576]: E0713 19:53:06.582431 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c\": container with ID starting with b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c not found: ID does not exist" containerID="b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c" Jul 13 19:53:06.582547 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.582465 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c"} err="failed to get container status \"b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c\": rpc error: code = NotFound desc = could not find container \"b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c\": container with ID starting with b83a2254964e76255f82d3cf06f0513a6ff12e671c9ceb3fecc60b3b8357496c not found: ID does not exist" Jul 13 19:53:06.593003 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.592979 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-844b75fcd-fq67s"] Jul 13 19:53:06.596142 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:06.596117 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-844b75fcd-fq67s"] Jul 13 19:53:07.244640 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.244602 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:07.364560 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.364518 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-844b75fcd-5r4p8"] Jul 13 19:53:07.364959 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.364946 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950f4154-b914-4ea4-88e9-c5f5e31f8be4" containerName="manager" Jul 13 19:53:07.365001 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.364961 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="950f4154-b914-4ea4-88e9-c5f5e31f8be4" containerName="manager" Jul 13 19:53:07.365033 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.365021 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="950f4154-b914-4ea4-88e9-c5f5e31f8be4" containerName="manager" Jul 13 19:53:07.369404 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.369383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.372469 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.372448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 19:53:07.372609 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.372531 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 19:53:07.372609 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.372531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p9jt2\"" Jul 13 19:53:07.382215 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.382185 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="950f4154-b914-4ea4-88e9-c5f5e31f8be4" path="/var/lib/kubelet/pods/950f4154-b914-4ea4-88e9-c5f5e31f8be4/volumes" Jul 13 19:53:07.382570 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.382548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844b75fcd-5r4p8"] Jul 13 19:53:07.485646 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.485607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smnjj\" (UniqueName: \"kubernetes.io/projected/b3cd724b-c0f1-48ab-ace2-78229780831f-kube-api-access-smnjj\") pod \"maas-controller-844b75fcd-5r4p8\" (UID: \"b3cd724b-c0f1-48ab-ace2-78229780831f\") " pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.485829 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.485703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3cd724b-c0f1-48ab-ace2-78229780831f-webhook-cert\") pod \"maas-controller-844b75fcd-5r4p8\" (UID: \"b3cd724b-c0f1-48ab-ace2-78229780831f\") " pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.587076 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.586993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smnjj\" (UniqueName: \"kubernetes.io/projected/b3cd724b-c0f1-48ab-ace2-78229780831f-kube-api-access-smnjj\") pod \"maas-controller-844b75fcd-5r4p8\" (UID: \"b3cd724b-c0f1-48ab-ace2-78229780831f\") " pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.587076 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.587044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3cd724b-c0f1-48ab-ace2-78229780831f-webhook-cert\") pod \"maas-controller-844b75fcd-5r4p8\" (UID: \"b3cd724b-c0f1-48ab-ace2-78229780831f\") " pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.589723 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.589696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3cd724b-c0f1-48ab-ace2-78229780831f-webhook-cert\") pod \"maas-controller-844b75fcd-5r4p8\" (UID: \"b3cd724b-c0f1-48ab-ace2-78229780831f\") " pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.596592 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.596572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smnjj\" (UniqueName: \"kubernetes.io/projected/b3cd724b-c0f1-48ab-ace2-78229780831f-kube-api-access-smnjj\") pod \"maas-controller-844b75fcd-5r4p8\" (UID: \"b3cd724b-c0f1-48ab-ace2-78229780831f\") " pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.682750 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.682720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:07.827005 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:07.826977 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844b75fcd-5r4p8"] Jul 13 19:53:07.828766 ip-10-0-138-30 kubenswrapper[2576]: W0713 19:53:07.828740 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cd724b_c0f1_48ab_ace2_78229780831f.slice/crio-b2ae09540feac74d03124bd3ddac7f344918e605f16e6ed237339a05d9e926a4 WatchSource:0}: Error finding container b2ae09540feac74d03124bd3ddac7f344918e605f16e6ed237339a05d9e926a4: Status 404 returned error can't find the container with id b2ae09540feac74d03124bd3ddac7f344918e605f16e6ed237339a05d9e926a4 Jul 13 19:53:08.586414 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:08.586379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b75fcd-5r4p8" event={"ID":"b3cd724b-c0f1-48ab-ace2-78229780831f","Type":"ContainerStarted","Data":"b2ae09540feac74d03124bd3ddac7f344918e605f16e6ed237339a05d9e926a4"} Jul 13 19:53:09.592799 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:09.592761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b75fcd-5r4p8" event={"ID":"b3cd724b-c0f1-48ab-ace2-78229780831f","Type":"ContainerStarted","Data":"4cecb945da447689f41d769e9de6fac14119990cfc5d76881ab437900b8f3444"} Jul 13 19:53:09.593210 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:09.592870 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:09.609832 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:09.609784 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-844b75fcd-5r4p8" podStartSLOduration=1.724967256 podStartE2EDuration="2.609769881s" totalImagesPullingTime="884.802625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:53:09.606887077 +0000 UTC m=+778.719082130" watchObservedRunningTime="2026-07-13 19:53:09.609769881 +0000 UTC m=+778.721964932" Jul 13 19:53:20.604680 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:20.604643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-844b75fcd-5r4p8" Jul 13 19:53:41.961896 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:41.961808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:42.049240 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:42.049202 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:42.203183 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:42.203141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:47.773196 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:47.773155 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:47.878862 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:47.878818 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:47.974044 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:47.974007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:48.651931 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:48.651899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:53.722702 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:53.722666 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:53.788732 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:53:53.788695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:55:11.336283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:55:11.336197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:55:11.336283 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:55:11.336197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 19:55:11.344147 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:55:11.344123 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:55:11.344338 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:55:11.344239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 19:56:43.730844 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:56:43.730772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:18.090589 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:57:18.090553 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:18.191348 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:57:18.191316 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:46.117568 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:57:46.117534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:39.547198 ip-10-0-138-30 kubenswrapper[2576]: I0713 19:59:39.547120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:11.373666 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:00:11.373631 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:00:11.375570 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:00:11.375549 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:00:11.382403 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:00:11.382381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:00:11.383737 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:00:11.383719 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:00:33.417148 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:00:33.417113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:15.216784 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:01:15.216684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:15.302329 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:01:15.302243 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:50.847787 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:04:50.847758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:01.957438 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:01.957397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:08.648492 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:08.648458 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:11.412009 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:11.411976 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:05:11.415334 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:11.415312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:05:11.419690 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:11.419669 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:05:11.422678 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:11.422662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:05:13.754113 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:13.754073 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:20.471492 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:05:20.471456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:22.675216 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:07:22.675181 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:09:35.713843 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:09:35.713809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:10:11.449414 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:10:11.449386 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:10:11.454069 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:10:11.454043 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:10:11.457115 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:10:11.457089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:10:11.461722 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:10:11.461701 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:11:08.314441 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:08.314382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:25.020901 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:25.020855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:25.118708 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:25.118634 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:25.454868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:25.454839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:31.186629 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:31.186582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:31.289359 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:31.289325 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:31.401566 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:31.401529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:31.501054 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:31.501014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:32.587183 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:32.587148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:32.687396 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:32.687361 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:35.262173 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:35.262134 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:37.565474 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:37.565436 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:37.752696 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:37.752662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:37.860662 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:37.860571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:39.259192 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:39.259160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:43.482385 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:43.482344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:43.546135 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:43.546092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:43.701824 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:43.701780 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:43.800321 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:43.800214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:44.869447 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:44.869407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:44.971270 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:44.971215 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:47.538333 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:47.538272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:49.875602 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:49.875562 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:50.814572 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:50.814525 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:50.914001 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:50.913963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:53.634615 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:53.634582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:56.845523 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:56.845487 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:56.934636 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:56.934591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:58.436837 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.436798 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:58.530779 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.530747 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:58.632792 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.632748 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6"] Jul 13 20:11:58.636470 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.636444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.638940 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.638920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5d9c011d-serving-cert\"" Jul 13 20:11:58.646915 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.646890 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6"] Jul 13 20:11:58.664634 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.664596 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:58.674630 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.674595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e801761a-82cf-4a22-8a57-4f9d16805824-maas-api-tls\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.674765 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.674719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e801761a-82cf-4a22-8a57-4f9d16805824-openshift-service-ca\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.674811 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.674785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rgc\" (UniqueName: \"kubernetes.io/projected/e801761a-82cf-4a22-8a57-4f9d16805824-kube-api-access-62rgc\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.776013 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.775973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e801761a-82cf-4a22-8a57-4f9d16805824-openshift-service-ca\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.776013 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.776019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62rgc\" (UniqueName: \"kubernetes.io/projected/e801761a-82cf-4a22-8a57-4f9d16805824-kube-api-access-62rgc\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.776226 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.776069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e801761a-82cf-4a22-8a57-4f9d16805824-maas-api-tls\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.776954 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.776918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e801761a-82cf-4a22-8a57-4f9d16805824-openshift-service-ca\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.778932 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.778908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e801761a-82cf-4a22-8a57-4f9d16805824-maas-api-tls\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.785698 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.785650 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:58.787441 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.787418 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rgc\" (UniqueName: \"kubernetes.io/projected/e801761a-82cf-4a22-8a57-4f9d16805824-kube-api-access-62rgc\") pod \"maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:58.950136 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:58.950100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:59.097445 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.097413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6"] Jul 13 20:11:59.099558 ip-10-0-138-30 kubenswrapper[2576]: W0713 20:11:59.099527 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode801761a_82cf_4a22_8a57_4f9d16805824.slice/crio-d1c3fd1711f887dcef4793b827c2367bbae950f119c2cae6a2950db5cbb7b9ad WatchSource:0}: Error finding container d1c3fd1711f887dcef4793b827c2367bbae950f119c2cae6a2950db5cbb7b9ad: Status 404 returned error can't find the container with id d1c3fd1711f887dcef4793b827c2367bbae950f119c2cae6a2950db5cbb7b9ad Jul 13 20:11:59.100905 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.100882 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:11:59.111705 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.111682 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:59.373654 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.373557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:59.958784 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.958748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" event={"ID":"e801761a-82cf-4a22-8a57-4f9d16805824","Type":"ContainerStarted","Data":"f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f"} Jul 13 20:11:59.959167 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.958837 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:11:59.959167 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.958855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" event={"ID":"e801761a-82cf-4a22-8a57-4f9d16805824","Type":"ContainerStarted","Data":"d1c3fd1711f887dcef4793b827c2367bbae950f119c2cae6a2950db5cbb7b9ad"} Jul 13 20:11:59.977855 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:11:59.977805 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" podStartSLOduration=1.215823605 podStartE2EDuration="1.977787798s" totalImagesPullingTime="761.964193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:11:59.976702103 +0000 UTC m=+1909.088897155" watchObservedRunningTime="2026-07-13 20:11:59.977787798 +0000 UTC m=+1909.089982874" Jul 13 20:12:00.291550 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:00.291507 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:02.464479 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.464442 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6"] Jul 13 20:12:02.465238 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.465203 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" podUID="e801761a-82cf-4a22-8a57-4f9d16805824" containerName="maas-api" containerID="cri-o://f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f" gracePeriod=30 Jul 13 20:12:02.492912 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.492860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:02.714869 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.714805 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:12:02.811830 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.811798 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e801761a-82cf-4a22-8a57-4f9d16805824-maas-api-tls\") pod \"e801761a-82cf-4a22-8a57-4f9d16805824\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " Jul 13 20:12:02.812014 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.811899 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62rgc\" (UniqueName: \"kubernetes.io/projected/e801761a-82cf-4a22-8a57-4f9d16805824-kube-api-access-62rgc\") pod \"e801761a-82cf-4a22-8a57-4f9d16805824\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " Jul 13 20:12:02.812014 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.811940 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e801761a-82cf-4a22-8a57-4f9d16805824-openshift-service-ca\") pod \"e801761a-82cf-4a22-8a57-4f9d16805824\" (UID: \"e801761a-82cf-4a22-8a57-4f9d16805824\") " Jul 13 20:12:02.812351 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.812321 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e801761a-82cf-4a22-8a57-4f9d16805824-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e801761a-82cf-4a22-8a57-4f9d16805824" (UID: "e801761a-82cf-4a22-8a57-4f9d16805824"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:12:02.814278 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.814230 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e801761a-82cf-4a22-8a57-4f9d16805824-kube-api-access-62rgc" (OuterVolumeSpecName: "kube-api-access-62rgc") pod "e801761a-82cf-4a22-8a57-4f9d16805824" (UID: "e801761a-82cf-4a22-8a57-4f9d16805824"). InnerVolumeSpecName "kube-api-access-62rgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:12:02.814353 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.814275 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e801761a-82cf-4a22-8a57-4f9d16805824-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e801761a-82cf-4a22-8a57-4f9d16805824" (UID: "e801761a-82cf-4a22-8a57-4f9d16805824"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:12:02.867508 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.867470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:02.912861 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.912826 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62rgc\" (UniqueName: \"kubernetes.io/projected/e801761a-82cf-4a22-8a57-4f9d16805824-kube-api-access-62rgc\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 20:12:02.912861 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.912856 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e801761a-82cf-4a22-8a57-4f9d16805824-openshift-service-ca\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 20:12:02.912861 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.912866 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e801761a-82cf-4a22-8a57-4f9d16805824-maas-api-tls\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 20:12:02.932726 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.932691 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:02.978904 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.978820 2576 generic.go:356] "Generic (PLEG): container finished" podID="e801761a-82cf-4a22-8a57-4f9d16805824" containerID="f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f" exitCode=0 Jul 13 20:12:02.978904 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.978871 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" Jul 13 20:12:02.979081 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.978906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" event={"ID":"e801761a-82cf-4a22-8a57-4f9d16805824","Type":"ContainerDied","Data":"f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f"} Jul 13 20:12:02.979081 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.978959 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6" event={"ID":"e801761a-82cf-4a22-8a57-4f9d16805824","Type":"ContainerDied","Data":"d1c3fd1711f887dcef4793b827c2367bbae950f119c2cae6a2950db5cbb7b9ad"} Jul 13 20:12:02.979081 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.978982 2576 scope.go:117] "RemoveContainer" containerID="f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f" Jul 13 20:12:02.988726 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.988705 2576 scope.go:117] "RemoveContainer" containerID="f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f" Jul 13 20:12:02.989027 ip-10-0-138-30 kubenswrapper[2576]: E0713 20:12:02.989006 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f\": container with ID starting with f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f not found: ID does not exist" containerID="f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f" Jul 13 20:12:02.989098 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:02.989041 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f"} err="failed to get container status \"f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f\": rpc error: code = NotFound desc = could not find container \"f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f\": container with ID starting with f5df783c92302432b52de113fa8299cca58276249dc6ea44e41fbd68a9afca6f not found: ID does not exist" Jul 13 20:12:03.001676 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:03.001643 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6"] Jul 13 20:12:03.007617 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:03.007589 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9c011d-64c677f47f-dp6k6"] Jul 13 20:12:03.381237 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:03.381154 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e801761a-82cf-4a22-8a57-4f9d16805824" path="/var/lib/kubelet/pods/e801761a-82cf-4a22-8a57-4f9d16805824/volumes" Jul 13 20:12:04.697010 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:04.696980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:08.859036 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:08.859005 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:10.294228 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:10.294169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:10.477794 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:10.477755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:11.056055 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:11.056019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:17.423530 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:17.423493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:17.541443 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:17.541413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:17.637858 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:17.637821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:17.740484 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:17.740450 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:18.141185 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:18.141079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:44.119966 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:44.119929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:50.317739 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:50.317702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:50.449006 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:50.448965 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:50.621833 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:12:50.621742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:07.255050 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:07.254962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:12.352674 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:12.352635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:12.468773 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:12.468736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:12.636055 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:12.635963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:23.142609 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:23.142559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:23.930760 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:23.930724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:29.981685 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:29.981638 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:30.086126 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:30.086086 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:30.192751 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:30.192715 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:30.296881 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:30.296783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:31.118212 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:31.118176 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:31.649938 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:31.649894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:31.775194 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:31.775157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:33.061208 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:33.061162 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:38.942980 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:38.942938 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:39.027739 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:39.027700 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:39.624833 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:39.624799 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:45.578173 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:45.578103 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:45.647618 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:45.647534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:45.833151 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:45.833060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:46.175807 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:46.175724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:46.557714 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:46.557675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:49.381955 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.381922 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:49.595145 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.595111 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2"] Jul 13 20:13:49.595580 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.595566 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e801761a-82cf-4a22-8a57-4f9d16805824" containerName="maas-api" Jul 13 20:13:49.595632 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.595582 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e801761a-82cf-4a22-8a57-4f9d16805824" containerName="maas-api" Jul 13 20:13:49.595672 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.595659 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e801761a-82cf-4a22-8a57-4f9d16805824" containerName="maas-api" Jul 13 20:13:49.598884 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.598857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.599292 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.599242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:49.603018 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.602995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f915346b-serving-cert\"" Jul 13 20:13:49.625602 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.625576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2"] Jul 13 20:13:49.689910 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.689818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.689910 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.689865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c03404-81f6-4744-9c14-fc8ba0fa7b55-openshift-service-ca\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.690126 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.689975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfrq\" (UniqueName: \"kubernetes.io/projected/68c03404-81f6-4744-9c14-fc8ba0fa7b55-kube-api-access-gmfrq\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.749854 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.749818 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:49.790502 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.790468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfrq\" (UniqueName: \"kubernetes.io/projected/68c03404-81f6-4744-9c14-fc8ba0fa7b55-kube-api-access-gmfrq\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.790678 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.790557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.790678 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.790600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c03404-81f6-4744-9c14-fc8ba0fa7b55-openshift-service-ca\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.790800 ip-10-0-138-30 kubenswrapper[2576]: E0713 20:13:49.790691 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-serving-cert: secret "maas-api-e2e-mt-f915346b-serving-cert" not found Jul 13 20:13:49.790800 ip-10-0-138-30 kubenswrapper[2576]: E0713 20:13:49.790773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls podName:68c03404-81f6-4744-9c14-fc8ba0fa7b55 nodeName:}" failed. No retries permitted until 2026-07-13 20:13:50.290748609 +0000 UTC m=+2019.402943641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls") pod "maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" (UID: "68c03404-81f6-4744-9c14-fc8ba0fa7b55") : secret "maas-api-e2e-mt-f915346b-serving-cert" not found Jul 13 20:13:49.791301 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.791279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c03404-81f6-4744-9c14-fc8ba0fa7b55-openshift-service-ca\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.803074 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.803036 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfrq\" (UniqueName: \"kubernetes.io/projected/68c03404-81f6-4744-9c14-fc8ba0fa7b55-kube-api-access-gmfrq\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:49.930527 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:49.930484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:50.294322 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:50.294283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:50.296964 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:50.296929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls\") pod \"maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:50.444500 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:50.444468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:50.509093 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:50.509060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:50.585329 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:50.585299 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:50.675986 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:50.675952 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2"] Jul 13 20:13:50.677691 ip-10-0-138-30 kubenswrapper[2576]: W0713 20:13:50.677662 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c03404_81f6_4744_9c14_fc8ba0fa7b55.slice/crio-2d0663909301a2d9a3b371cb4d56ee99f8103c337371f4a395726451fe175005 WatchSource:0}: Error finding container 2d0663909301a2d9a3b371cb4d56ee99f8103c337371f4a395726451fe175005: Status 404 returned error can't find the container with id 2d0663909301a2d9a3b371cb4d56ee99f8103c337371f4a395726451fe175005 Jul 13 20:13:51.591587 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:51.591544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" event={"ID":"68c03404-81f6-4744-9c14-fc8ba0fa7b55","Type":"ContainerStarted","Data":"2d0663909301a2d9a3b371cb4d56ee99f8103c337371f4a395726451fe175005"} Jul 13 20:13:52.598137 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:52.598102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" event={"ID":"68c03404-81f6-4744-9c14-fc8ba0fa7b55","Type":"ContainerStarted","Data":"900d6e4e8ab605ec8e8a36fab02d620471ba59e1b2038d7c841f9be6dacfa111"} Jul 13 20:13:52.598543 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:52.598227 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:13:52.621276 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:52.621209 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" podStartSLOduration=2.537331259 podStartE2EDuration="3.621194458s" totalImagesPullingTime="1.083863199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:13:52.619545902 +0000 UTC m=+2021.731740952" watchObservedRunningTime="2026-07-13 20:13:52.621194458 +0000 UTC m=+2021.733389520" Jul 13 20:13:53.880229 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:53.880188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:54.621721 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:54.621684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:54.713362 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:54.713326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:55.141104 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:55.141017 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:58.608752 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:13:58.608716 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:14:01.108231 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.108196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:01.212130 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.212091 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:01.482943 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.482912 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2"] Jul 13 20:14:01.483122 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.483103 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" podUID="68c03404-81f6-4744-9c14-fc8ba0fa7b55" containerName="maas-api" containerID="cri-o://900d6e4e8ab605ec8e8a36fab02d620471ba59e1b2038d7c841f9be6dacfa111" gracePeriod=30 Jul 13 20:14:01.547563 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.547529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:01.625579 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.625542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:01.652760 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.652727 2576 generic.go:356] "Generic (PLEG): container finished" podID="68c03404-81f6-4744-9c14-fc8ba0fa7b55" containerID="900d6e4e8ab605ec8e8a36fab02d620471ba59e1b2038d7c841f9be6dacfa111" exitCode=0 Jul 13 20:14:01.652955 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.652766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" event={"ID":"68c03404-81f6-4744-9c14-fc8ba0fa7b55","Type":"ContainerDied","Data":"900d6e4e8ab605ec8e8a36fab02d620471ba59e1b2038d7c841f9be6dacfa111"} Jul 13 20:14:01.740517 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.740449 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:14:01.904025 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.903989 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c03404-81f6-4744-9c14-fc8ba0fa7b55-openshift-service-ca\") pod \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " Jul 13 20:14:01.904025 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.904025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmfrq\" (UniqueName: \"kubernetes.io/projected/68c03404-81f6-4744-9c14-fc8ba0fa7b55-kube-api-access-gmfrq\") pod \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " Jul 13 20:14:01.904293 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.904056 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls\") pod \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\" (UID: \"68c03404-81f6-4744-9c14-fc8ba0fa7b55\") " Jul 13 20:14:01.904487 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.904463 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68c03404-81f6-4744-9c14-fc8ba0fa7b55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68c03404-81f6-4744-9c14-fc8ba0fa7b55" (UID: "68c03404-81f6-4744-9c14-fc8ba0fa7b55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:14:01.906379 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.906346 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68c03404-81f6-4744-9c14-fc8ba0fa7b55-kube-api-access-gmfrq" (OuterVolumeSpecName: "kube-api-access-gmfrq") pod "68c03404-81f6-4744-9c14-fc8ba0fa7b55" (UID: "68c03404-81f6-4744-9c14-fc8ba0fa7b55"). InnerVolumeSpecName "kube-api-access-gmfrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:14:01.906483 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.906394 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68c03404-81f6-4744-9c14-fc8ba0fa7b55" (UID: "68c03404-81f6-4744-9c14-fc8ba0fa7b55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:14:01.944144 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:01.944105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:02.005519 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.005436 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c03404-81f6-4744-9c14-fc8ba0fa7b55-openshift-service-ca\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 20:14:02.005519 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.005470 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmfrq\" (UniqueName: \"kubernetes.io/projected/68c03404-81f6-4744-9c14-fc8ba0fa7b55-kube-api-access-gmfrq\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 20:14:02.005519 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.005479 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68c03404-81f6-4744-9c14-fc8ba0fa7b55-maas-api-tls\") on node \"ip-10-0-138-30.ec2.internal\" DevicePath \"\"" Jul 13 20:14:02.660215 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.660175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" event={"ID":"68c03404-81f6-4744-9c14-fc8ba0fa7b55","Type":"ContainerDied","Data":"2d0663909301a2d9a3b371cb4d56ee99f8103c337371f4a395726451fe175005"} Jul 13 20:14:02.660215 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.660208 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2" Jul 13 20:14:02.660691 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.660272 2576 scope.go:117] "RemoveContainer" containerID="900d6e4e8ab605ec8e8a36fab02d620471ba59e1b2038d7c841f9be6dacfa111" Jul 13 20:14:02.684934 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.684904 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2"] Jul 13 20:14:02.691950 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:02.691925 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f915346b-5464b44c7b-mnjk2"] Jul 13 20:14:03.383701 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:03.383657 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68c03404-81f6-4744-9c14-fc8ba0fa7b55" path="/var/lib/kubelet/pods/68c03404-81f6-4744-9c14-fc8ba0fa7b55/volumes" Jul 13 20:14:09.137054 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:09.137022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:09.242873 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:09.242841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:09.462402 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:09.462362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:09.657130 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:09.657089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:09.777197 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:09.777106 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:09.881640 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:09.881610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:10.002591 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:10.002554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:10.893952 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:10.893910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:15.819111 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:15.819070 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:15.933409 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:15.933372 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:16.027389 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:16.027358 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:16.169374 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:16.169277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:22.027651 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:22.027612 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:22.094425 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:22.094386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:28.949163 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:28.949129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:29.390666 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:29.390624 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:29.630265 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:29.630219 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:32.440354 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:32.440244 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:32.541056 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:32.541022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:36.955653 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:14:36.955609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:00.139105 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.139069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb"] Jul 13 20:15:00.139550 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.139461 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68c03404-81f6-4744-9c14-fc8ba0fa7b55" containerName="maas-api" Jul 13 20:15:00.139550 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.139472 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68c03404-81f6-4744-9c14-fc8ba0fa7b55" containerName="maas-api" Jul 13 20:15:00.139621 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.139555 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68c03404-81f6-4744-9c14-fc8ba0fa7b55" containerName="maas-api" Jul 13 20:15:00.142583 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.142564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" Jul 13 20:15:00.145019 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.144997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f2dhd\"" Jul 13 20:15:00.149778 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.149753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb"] Jul 13 20:15:00.153776 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.153754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" Jul 13 20:15:00.293436 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.293411 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb"] Jul 13 20:15:00.294770 ip-10-0-138-30 kubenswrapper[2576]: W0713 20:15:00.294742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf545ae11_e215_4dbb_b1ef_e2e604d62f1a.slice/crio-f0bc3571a699698778b33e1a0302802c944104be67ab7cbc03c49905f29669ab WatchSource:0}: Error finding container f0bc3571a699698778b33e1a0302802c944104be67ab7cbc03c49905f29669ab: Status 404 returned error can't find the container with id f0bc3571a699698778b33e1a0302802c944104be67ab7cbc03c49905f29669ab Jul 13 20:15:00.998325 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:00.998290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" event={"ID":"f545ae11-e215-4dbb-b1ef-e2e604d62f1a","Type":"ContainerStarted","Data":"f0bc3571a699698778b33e1a0302802c944104be67ab7cbc03c49905f29669ab"} Jul 13 20:15:04.408720 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:04.408677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:11.487346 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:11.487318 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:15:11.492460 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:11.492436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:15:11.494889 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:11.494859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:15:11.500318 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:11.500298 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:15:16.089424 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:16.089385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" event={"ID":"f545ae11-e215-4dbb-b1ef-e2e604d62f1a","Type":"ContainerStarted","Data":"cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77"} Jul 13 20:15:16.108474 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:16.108420 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" podStartSLOduration=1.010620727 podStartE2EDuration="16.108403996s" totalImagesPullingTime="15.097783269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:15:16.10554203 +0000 UTC m=+2105.217737081" watchObservedRunningTime="2026-07-13 20:15:16.108403996 +0000 UTC m=+2105.220599061" Jul 13 20:15:53.577697 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:15:53.577661 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:16:00.011738 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:00.011703 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb"] Jul 13 20:16:00.012168 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:00.011904 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" podUID="f545ae11-e215-4dbb-b1ef-e2e604d62f1a" containerName="cleanup" containerID="cri-o://cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77" gracePeriod=30 Jul 13 20:16:30.196306 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.196276 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" Jul 13 20:16:30.501810 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.501778 2576 generic.go:356] "Generic (PLEG): container finished" podID="f545ae11-e215-4dbb-b1ef-e2e604d62f1a" containerID="cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77" exitCode=137 Jul 13 20:16:30.501992 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.501826 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" Jul 13 20:16:30.501992 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.501865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" event={"ID":"f545ae11-e215-4dbb-b1ef-e2e604d62f1a","Type":"ContainerDied","Data":"cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77"} Jul 13 20:16:30.501992 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.501921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb" event={"ID":"f545ae11-e215-4dbb-b1ef-e2e604d62f1a","Type":"ContainerDied","Data":"f0bc3571a699698778b33e1a0302802c944104be67ab7cbc03c49905f29669ab"} Jul 13 20:16:30.501992 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.501943 2576 scope.go:117] "RemoveContainer" containerID="cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77" Jul 13 20:16:30.511299 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.511277 2576 scope.go:117] "RemoveContainer" containerID="cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77" Jul 13 20:16:30.511565 ip-10-0-138-30 kubenswrapper[2576]: E0713 20:16:30.511547 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77\": container with ID starting with cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77 not found: ID does not exist" containerID="cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77" Jul 13 20:16:30.511632 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.511574 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77"} err="failed to get container status \"cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77\": rpc error: code = NotFound desc = could not find container \"cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77\": container with ID starting with cdeb61f24afc2444a992d87b6496f9bf1dd0189fb2bca6554031b961f9c38d77 not found: ID does not exist" Jul 13 20:16:30.523919 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.523892 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb"] Jul 13 20:16:30.526203 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:30.526181 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732895-bw5tb"] Jul 13 20:16:31.381654 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:16:31.381618 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f545ae11-e215-4dbb-b1ef-e2e604d62f1a" path="/var/lib/kubelet/pods/f545ae11-e215-4dbb-b1ef-e2e604d62f1a/volumes" Jul 13 20:17:19.846407 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:19.846365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:21.288446 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:21.288394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:41.634814 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:41.634732 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:42.050426 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:42.050382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:47.891183 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:47.891145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:47.962963 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:47.962924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:48.178583 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:48.178484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:48.506630 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:48.506591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:49.587545 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:49.587509 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:49.683433 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:49.683385 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:50.437887 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:50.437853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:50.541963 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:50.541918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:50.684323 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:50.684288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:52.022645 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:52.022600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:58.135012 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:58.134971 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:58.196892 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:58.196854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:17:58.802053 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:17:58.802019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:04.644004 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:04.643969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:04.752082 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:04.752045 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:04.845267 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:04.845215 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:15.330921 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:15.330883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:15.682488 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:15.682392 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:36.656609 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:36.656566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:42.323049 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:42.323001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:42.423067 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:42.423025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:42.718143 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:42.718110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:43.120150 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:43.120045 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:43.228560 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:43.228529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:45.743271 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:45.743214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:45.840030 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:45.839996 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:18:50.238503 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:18:50.238466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:11.523876 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:20:11.523844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:20:11.531067 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:20:11.531046 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:20:11.532104 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:20:11.532080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:20:11.539332 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:20:11.539315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6frd_f7250f25-6011-48c2-a234-e8c7f1a94cbc/ovn-acl-logging/0.log" Jul 13 20:20:21.875002 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:20:21.874963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:54.951644 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:21:54.951610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:55.332120 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:21:55.332085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:01.096169 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:01.096132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:01.164575 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:01.164544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:01.376615 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:01.376515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:01.593642 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:01.593565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:09.161584 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:09.161546 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-844b75fcd-5r4p8_b3cd724b-c0f1-48ab-ace2-78229780831f/manager/0.log" Jul 13 20:22:09.751815 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:09.751788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-747899cbfc-bdz6c_d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4/copy-manifests/0.log" Jul 13 20:22:09.758984 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:09.758943 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-747899cbfc-bdz6c_d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4/manager/0.log" Jul 13 20:22:10.317856 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:10.317826 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6956f54f6b-sxkxn_4b7ecc18-c4a7-4a63-9740-de3ca2867fcf/maas-api/0.log" Jul 13 20:22:10.448535 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:10.448502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8hdgq_b7499cac-28c8-4f6f-be18-847a4c75f10c/postgres/0.log" Jul 13 20:22:11.435027 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.434999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn_45fb95c3-9a1c-470c-8f44-1a64f6b9dbac/util/0.log" Jul 13 20:22:11.441135 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.441116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn_45fb95c3-9a1c-470c-8f44-1a64f6b9dbac/pull/0.log" Jul 13 20:22:11.447704 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.447684 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn_45fb95c3-9a1c-470c-8f44-1a64f6b9dbac/extract/0.log" Jul 13 20:22:11.597160 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.597128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm_76dca588-cf79-42ce-a8ea-5cf81e8e4153/util/0.log" Jul 13 20:22:11.603689 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.603665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm_76dca588-cf79-42ce-a8ea-5cf81e8e4153/pull/0.log" Jul 13 20:22:11.609887 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.609864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm_76dca588-cf79-42ce-a8ea-5cf81e8e4153/extract/0.log" Jul 13 20:22:11.762602 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.762572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v_0e30beee-69f7-4961-8a66-e45302f7d340/util/0.log" Jul 13 20:22:11.769451 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.769424 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v_0e30beee-69f7-4961-8a66-e45302f7d340/pull/0.log" Jul 13 20:22:11.775828 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.775810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v_0e30beee-69f7-4961-8a66-e45302f7d340/extract/0.log" Jul 13 20:22:11.926705 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.926666 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw_34c149d0-9478-4589-863a-42a509b04e0e/util/0.log" Jul 13 20:22:11.934385 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.934357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw_34c149d0-9478-4589-863a-42a509b04e0e/pull/0.log" Jul 13 20:22:11.940943 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:11.940926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw_34c149d0-9478-4589-863a-42a509b04e0e/extract/0.log" Jul 13 20:22:12.235576 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:12.235548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dlh2z_c04bac81-72f2-4722-a770-8bc7cb460569/manager/0.log" Jul 13 20:22:12.387267 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:12.387223 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dxv7p_fdbe6c5b-66fc-431c-82c3-22695d1ad92a/manager/0.log" Jul 13 20:22:13.206190 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:13.206153 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9xlwt_efe0561c-ecf9-4fdf-a5ee-799a9de5b282/manager/0.log" Jul 13 20:22:13.806473 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:13.806446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jch4l_c0f49298-684d-4a58-9e84-b2cb9a3fa82e/discovery/0.log" Jul 13 20:22:14.082778 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:14.082691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84785469bd-zc42h_8385fdd1-a4a0-4fff-b95a-3093d98147da/kube-auth-proxy/0.log" Jul 13 20:22:14.376338 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:14.376242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8w22j_3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc/payload-pre-processing/0.log" Jul 13 20:22:14.652297 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:14.652203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6499879966-8cxc8_002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea/router/0.log" Jul 13 20:22:15.080041 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:15.080005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fsdw7_f42dbbac-6ce3-471d-a196-e04a7ec8e7b3/main/0.log" Jul 13 20:22:15.488957 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:15.488930 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp267m_e7984a29-80cc-4843-85dc-ec91a6ec9a7a/main/0.log" Jul 13 20:22:20.473393 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:20.473358 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:20.572861 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:20.572832 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:20.710053 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:20.710014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:23.441977 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:23.441940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pqb4t_05c816ec-c5a3-490c-84b5-a0acc65f56c4/global-pull-secret-syncer/0.log" Jul 13 20:22:23.563682 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:23.563648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4qkzc_23296317-6bbe-4754-8973-ed96f2cb6370/konnectivity-agent/0.log" Jul 13 20:22:23.713525 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:23.713490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-30.ec2.internal_e03e2aa8c921c7d74e9b77683073fbc0/haproxy/0.log" Jul 13 20:22:27.778447 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:27.778411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn_45fb95c3-9a1c-470c-8f44-1a64f6b9dbac/extract/0.log" Jul 13 20:22:27.826391 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:27.826363 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn_45fb95c3-9a1c-470c-8f44-1a64f6b9dbac/util/0.log" Jul 13 20:22:27.862347 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:27.862323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594n6gn_45fb95c3-9a1c-470c-8f44-1a64f6b9dbac/pull/0.log" Jul 13 20:22:27.907553 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:27.907520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm_76dca588-cf79-42ce-a8ea-5cf81e8e4153/extract/0.log" Jul 13 20:22:27.943958 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:27.943926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm_76dca588-cf79-42ce-a8ea-5cf81e8e4153/util/0.log" Jul 13 20:22:27.966449 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:27.966425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdtlm_76dca588-cf79-42ce-a8ea-5cf81e8e4153/pull/0.log" Jul 13 20:22:28.000965 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.000926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v_0e30beee-69f7-4961-8a66-e45302f7d340/extract/0.log" Jul 13 20:22:28.028174 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.028142 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v_0e30beee-69f7-4961-8a66-e45302f7d340/util/0.log" Jul 13 20:22:28.056017 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.055934 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rd76v_0e30beee-69f7-4961-8a66-e45302f7d340/pull/0.log" Jul 13 20:22:28.099325 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.099294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw_34c149d0-9478-4589-863a-42a509b04e0e/extract/0.log" Jul 13 20:22:28.130759 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.130735 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw_34c149d0-9478-4589-863a-42a509b04e0e/util/0.log" Jul 13 20:22:28.153955 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.153927 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nsknw_34c149d0-9478-4589-863a-42a509b04e0e/pull/0.log" Jul 13 20:22:28.567688 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.567659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dlh2z_c04bac81-72f2-4722-a770-8bc7cb460569/manager/0.log" Jul 13 20:22:28.600838 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.600809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dxv7p_fdbe6c5b-66fc-431c-82c3-22695d1ad92a/manager/0.log" Jul 13 20:22:28.900681 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:28.900602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9xlwt_efe0561c-ecf9-4fdf-a5ee-799a9de5b282/manager/0.log" Jul 13 20:22:30.537821 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.537792 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/alertmanager/0.log" Jul 13 20:22:30.580607 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.580581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/config-reloader/0.log" Jul 13 20:22:30.623689 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.623659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/kube-rbac-proxy-web/0.log" Jul 13 20:22:30.664404 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.664378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/kube-rbac-proxy/0.log" Jul 13 20:22:30.712326 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.712294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/kube-rbac-proxy-metric/0.log" Jul 13 20:22:30.765513 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.765487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/prom-label-proxy/0.log" Jul 13 20:22:30.906566 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.906543 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8129d6b3-913e-4d01-822a-6ac1fda65c1d/init-config-reloader/0.log" Jul 13 20:22:30.969972 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:30.969947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-7qjlq_53315d04-852c-42b4-88e5-f7322b19d684/cluster-monitoring-operator/0.log" Jul 13 20:22:31.269471 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.269441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-m4zd4_ad444f74-0d39-4bd2-a59b-91b7379d5f45/monitoring-plugin/0.log" Jul 13 20:22:31.317997 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.317965 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdg26_519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0/node-exporter/0.log" Jul 13 20:22:31.344650 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.344618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdg26_519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0/kube-rbac-proxy/0.log" Jul 13 20:22:31.380664 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.380641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdg26_519d37e1-bcf3-42f2-8ab5-b7fd62b9b3c0/init-textfile/0.log" Jul 13 20:22:31.773593 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.773564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bs7xv_bd261b02-81cf-4399-aef1-079fc74ae101/kube-rbac-proxy-main/0.log" Jul 13 20:22:31.846190 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.846166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bs7xv_bd261b02-81cf-4399-aef1-079fc74ae101/kube-rbac-proxy-self/0.log" Jul 13 20:22:31.891289 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:31.891237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bs7xv_bd261b02-81cf-4399-aef1-079fc74ae101/openshift-state-metrics/0.log" Jul 13 20:22:33.728568 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:33.728535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4xz49_38e14e91-6a0f-4516-82f2-db2c308db3d9/networking-console-plugin/0.log" Jul 13 20:22:34.195007 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.194928 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l"] Jul 13 20:22:34.195371 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.195357 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f545ae11-e215-4dbb-b1ef-e2e604d62f1a" containerName="cleanup" Jul 13 20:22:34.195420 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.195373 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f545ae11-e215-4dbb-b1ef-e2e604d62f1a" containerName="cleanup" Jul 13 20:22:34.195462 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.195446 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f545ae11-e215-4dbb-b1ef-e2e604d62f1a" containerName="cleanup" Jul 13 20:22:34.198702 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.198675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.204791 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.204769 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f49qh\"/\"kube-root-ca.crt\"" Jul 13 20:22:34.204939 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.204769 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f49qh\"/\"default-dockercfg-nkrqc\"" Jul 13 20:22:34.204939 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.204771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f49qh\"/\"openshift-service-ca.crt\"" Jul 13 20:22:34.231186 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.231150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l"] Jul 13 20:22:34.243803 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.243756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-podres\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.244001 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.243823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkfhz\" (UniqueName: \"kubernetes.io/projected/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-kube-api-access-vkfhz\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.244001 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.243915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-sys\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.244001 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.243949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-proc\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.244186 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.244072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-lib-modules\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344683 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-lib-modules\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-podres\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfhz\" (UniqueName: \"kubernetes.io/projected/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-kube-api-access-vkfhz\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-sys\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-proc\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-sys\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.344868 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-lib-modules\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.345069 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-proc\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.345069 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.344907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-podres\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.353795 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.353769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkfhz\" (UniqueName: \"kubernetes.io/projected/f71dc088-503f-4a1e-be3e-6f8961aa5d8f-kube-api-access-vkfhz\") pod \"perf-node-gather-daemonset-ltb2l\" (UID: \"f71dc088-503f-4a1e-be3e-6f8961aa5d8f\") " pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.372742 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.372710 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/1.log" Jul 13 20:22:34.377994 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.377967 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s8h8b_585ae350-7e19-4c34-8ceb-64fda6697b08/console-operator/2.log" Jul 13 20:22:34.508327 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.508291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:34.672442 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:34.672414 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l"] Jul 13 20:22:34.674703 ip-10-0-138-30 kubenswrapper[2576]: W0713 20:22:34.674659 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf71dc088_503f_4a1e_be3e_6f8961aa5d8f.slice/crio-bcbb0500cbd13e76d53b64c5c36171a5a2ab49cbb1ab275076353ed656662f2c WatchSource:0}: Error finding container bcbb0500cbd13e76d53b64c5c36171a5a2ab49cbb1ab275076353ed656662f2c: Status 404 returned error can't find the container with id bcbb0500cbd13e76d53b64c5c36171a5a2ab49cbb1ab275076353ed656662f2c Jul 13 20:22:35.549516 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:35.549480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" event={"ID":"f71dc088-503f-4a1e-be3e-6f8961aa5d8f","Type":"ContainerStarted","Data":"3e97e5d68687f940b3217f458e08203105e008a77eda443f9af717655be6acbc"} Jul 13 20:22:35.549936 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:35.549531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" event={"ID":"f71dc088-503f-4a1e-be3e-6f8961aa5d8f","Type":"ContainerStarted","Data":"bcbb0500cbd13e76d53b64c5c36171a5a2ab49cbb1ab275076353ed656662f2c"} Jul 13 20:22:35.549936 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:35.549617 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:35.572885 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:35.572855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-zv9gn_e763b060-70e0-4129-aeda-4bbd78420271/volume-data-source-validator/0.log" Jul 13 20:22:36.733492 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:36.733462 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gr8lz_cd74ad67-8477-42a3-a0ae-94356f55ca19/dns/0.log" Jul 13 20:22:36.758334 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:36.758306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gr8lz_cd74ad67-8477-42a3-a0ae-94356f55ca19/kube-rbac-proxy/0.log" Jul 13 20:22:36.955023 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:36.954991 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nglhf_b1f4a4e8-173a-47ab-a4ee-153aa40302bf/dns-node-resolver/0.log" Jul 13 20:22:37.580443 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:37.580418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6bh9_95c8cbcb-e64a-4ebc-80a8-3ef9fb70a8ba/node-ca/0.log" Jul 13 20:22:38.688133 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:38.688104 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jch4l_c0f49298-684d-4a58-9e84-b2cb9a3fa82e/discovery/0.log" Jul 13 20:22:38.747002 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:38.746973 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84785469bd-zc42h_8385fdd1-a4a0-4fff-b95a-3093d98147da/kube-auth-proxy/0.log" Jul 13 20:22:38.887283 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:38.886728 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8w22j_3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc/payload-pre-processing/0.log" Jul 13 20:22:38.947164 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:38.947086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6499879966-8cxc8_002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea/router/0.log" Jul 13 20:22:39.729807 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:39.729777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7n4j_d2c38e98-5d9e-45a1-b02f-b06bef324e6f/serve-healthcheck-canary/0.log" Jul 13 20:22:40.311345 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:40.311308 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rvr4q_e08f6c3e-9242-4765-9c14-f43ae23d6ae8/insights-operator/0.log" Jul 13 20:22:40.312706 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:40.312686 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rvr4q_e08f6c3e-9242-4765-9c14-f43ae23d6ae8/insights-operator/1.log" Jul 13 20:22:40.570471 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:40.570394 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sv6gj_d1a860ee-27b6-46ea-ba75-d4741aed57b3/kube-rbac-proxy/0.log" Jul 13 20:22:40.597537 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:40.597513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sv6gj_d1a860ee-27b6-46ea-ba75-d4741aed57b3/exporter/0.log" Jul 13 20:22:40.629985 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:40.629954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sv6gj_d1a860ee-27b6-46ea-ba75-d4741aed57b3/extractor/0.log" Jul 13 20:22:41.565619 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:41.565586 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" Jul 13 20:22:41.594738 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:41.594675 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f49qh/perf-node-gather-daemonset-ltb2l" podStartSLOduration=7.5946607539999995 podStartE2EDuration="7.594660754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:22:35.586990059 +0000 UTC m=+2544.699185111" watchObservedRunningTime="2026-07-13 20:22:41.594660754 +0000 UTC m=+2550.706855805" Jul 13 20:22:43.227259 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.227225 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-844b75fcd-5r4p8_b3cd724b-c0f1-48ab-ace2-78229780831f/manager/0.log" Jul 13 20:22:43.551550 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.551518 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-747899cbfc-bdz6c_d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4/manager/0.log" Jul 13 20:22:43.611479 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.611394 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-747899cbfc-bdz6c_d4c9b12f-c012-4ab9-af4f-c33ffbf3ecc4/copy-manifests/0.log" Jul 13 20:22:43.633369 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.633342 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jch4l_c0f49298-684d-4a58-9e84-b2cb9a3fa82e/discovery/0.log" Jul 13 20:22:43.693579 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.693552 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84785469bd-zc42h_8385fdd1-a4a0-4fff-b95a-3093d98147da/kube-auth-proxy/0.log" Jul 13 20:22:43.877865 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.877775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8w22j_3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc/payload-pre-processing/0.log" Jul 13 20:22:43.936349 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:43.936325 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6499879966-8cxc8_002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea/router/0.log" Jul 13 20:22:45.147903 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:45.147871 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jch4l_c0f49298-684d-4a58-9e84-b2cb9a3fa82e/discovery/0.log" Jul 13 20:22:45.185065 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:45.185025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84785469bd-zc42h_8385fdd1-a4a0-4fff-b95a-3093d98147da/kube-auth-proxy/0.log" Jul 13 20:22:45.243864 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:45.243839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4vbgf_e28edbbe-0904-4370-ab70-1d595dd83a1c/openshift-lws-operator/0.log" Jul 13 20:22:45.293029 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:45.293003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8w22j_3cf0d4d8-a1a7-41f5-bd31-b95c5689aafc/payload-pre-processing/0.log" Jul 13 20:22:45.339061 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:45.339033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6499879966-8cxc8_002d33f7-e5a1-4fc8-b0c2-f2d5f07824ea/router/0.log" Jul 13 20:22:50.669210 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:50.669179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-t294p_7af54ba5-4deb-4fe4-91a7-8a89474402ea/kube-storage-version-migrator-operator/1.log" Jul 13 20:22:50.669865 ip-10-0-138-30 kubenswrapper[2576]: I0713 20:22:50.669849 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-t294p_7af54ba5-4deb-4fe4-91a7-8a89474402ea/kube-storage-version-migrator-operator/0.log"