Jul 29 00:06:03.726789 ip-10-0-133-130 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 00:06:03.726803 ip-10-0-133-130 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 00:06:03.726814 ip-10-0-133-130 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 00:06:03.727145 ip-10-0-133-130 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 00:06:13.803115 ip-10-0-133-130 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 00:06:13.803131 ip-10-0-133-130 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8d8a0eb90a2842cdacdd9eb82c435c74 -- Jul 29 00:08:23.362803 ip-10-0-133-130 systemd[1]: Starting Kubernetes Kubelet... Jul 29 00:08:23.787566 ip-10-0-133-130 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 00:08:23.787566 ip-10-0-133-130 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 00:08:23.787566 ip-10-0-133-130 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 00:08:23.787566 ip-10-0-133-130 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 00:08:23.787566 ip-10-0-133-130 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 00:08:23.790018 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.789876 2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795833 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795851 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795855 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795859 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795863 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795866 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 00:08:23.795860 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795869 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795873 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795876 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795879 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795882 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795885 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795887 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795890 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795893 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795896 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795899 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795902 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795905 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795907 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795910 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795913 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795916 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795919 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795922 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795925 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 00:08:23.796121 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795927 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795930 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795933 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795936 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795938 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795943 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795946 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795949 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795952 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795955 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795959 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795963 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795966 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795969 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795973 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795976 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795979 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795984 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795988 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 00:08:23.796660 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795992 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795995 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.795998 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796001 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796004 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796007 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796010 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796013 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796016 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796020 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796023 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796027 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796030 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796034 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796037 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796040 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796044 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796047 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796051 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796054 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 00:08:23.797163 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796056 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796059 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796062 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796065 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796068 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796071 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796073 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796078 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796080 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796083 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796086 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796089 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796093 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796096 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796099 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796102 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796105 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796108 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796111 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796114 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 00:08:23.797704 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796117 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796120 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796123 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796126 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796129 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796132 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796135 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796138 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796141 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796144 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796147 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796150 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796153 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796156 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796922 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796929 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796933 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796936 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796940 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796944 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 29 00:08:23.798249 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796947 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796950 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796953 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796956 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796959 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796962 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796965 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796968 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796970 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796973 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796976 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796979 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796982 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796985 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796988 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796991 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796994 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796996 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.796999 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797002 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 00:08:23.798788 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797004 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797007 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797010 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797013 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797016 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797018 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797021 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797024 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797027 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797030 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797033 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797037 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797040 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797043 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797045 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797048 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797051 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797054 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797057 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797060 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 00:08:23.799334 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797064 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797066 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797069 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797071 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797075 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797079 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797082 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797085 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797089 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797093 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797096 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797099 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797101 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797104 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797108 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797111 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797113 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797116 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797119 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 00:08:23.799876 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797122 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797125 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797130 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797134 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797137 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797141 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797144 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797148 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797151 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797154 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797157 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797160 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797163 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797166 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797168 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797171 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797174 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797177 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797181 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 00:08:23.800360 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797184 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797187 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797189 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797192 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797195 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797198 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797202 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797206 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797209 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797213 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797216 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797219 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797222 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797226 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797229 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797651 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797657 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797661 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797664 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 00:08:23.800868 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797667 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797670 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797673 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797676 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797679 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797682 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797685 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797688 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797691 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797693 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797696 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797700 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797704 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797708 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797712 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797715 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797718 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797721 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797726 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 00:08:23.801386 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797729 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797736 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797739 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797743 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797746 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797750 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797754 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797757 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797760 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797763 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797766 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797769 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797772 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797775 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797778 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797780 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797783 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797786 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797789 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797792 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 00:08:23.801900 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797794 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797797 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797800 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797803 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797806 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797809 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797812 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797816 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797819 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797823 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797827 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797830 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797833 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797837 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797840 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797843 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797846 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797849 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797852 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 00:08:23.802426 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797855 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797858 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797861 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797865 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797868 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797872 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797874 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797877 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797881 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797884 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797887 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797890 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797893 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797895 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797898 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797901 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797903 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797906 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797909 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797912 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 00:08:23.802971 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797915 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797918 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797921 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797923 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797926 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797929 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797933 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797936 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797939 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797941 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797944 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797947 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797950 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797952 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797955 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797958 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.797961 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798037 2550 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798045 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798052 2550 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798056 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 00:08:23.803658 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798061 2550 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798065 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798070 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798074 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798077 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798080 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798084 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798087 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798091 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798094 2550 flags.go:64] FLAG: --cgroup-root="" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798097 2550 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798100 2550 flags.go:64] FLAG: --client-ca-file="" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798104 2550 flags.go:64] FLAG: --cloud-provider="external" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798107 2550 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798112 2550 flags.go:64] FLAG: --cluster-domain="" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798115 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798118 2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798125 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798129 2550 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798132 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798136 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798139 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798143 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798146 2550 flags.go:64] FLAG: --contention-profiling="false" Jul 29 00:08:23.804235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798149 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798152 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798155 2550 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798158 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798163 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798166 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798169 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798173 2550 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798176 2550 flags.go:64] FLAG: --enable-server="true" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798179 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798187 2550 flags.go:64] FLAG: --event-burst="100" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798190 2550 flags.go:64] FLAG: --event-qps="50" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798194 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798197 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798200 2550 flags.go:64] FLAG: --eviction-hard="" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798204 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798207 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798210 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798214 2550 flags.go:64] FLAG: --eviction-soft="" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798217 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798220 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798224 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798227 2550 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798231 2550 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798234 2550 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 00:08:23.804914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798241 2550 flags.go:64] FLAG: --feature-gates="" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798245 2550 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798248 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798252 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798255 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798258 2550 flags.go:64] FLAG: --healthz-port="10248" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798262 2550 flags.go:64] FLAG: --help="false" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798265 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-133-130.ec2.internal" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798269 2550 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798272 2550 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798275 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798279 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798283 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798286 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798289 2550 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798292 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798295 2550 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798299 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798302 2550 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798305 2550 flags.go:64] FLAG: --kube-reserved="" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798309 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798312 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798315 2550 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798318 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 00:08:23.805576 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798321 2550 flags.go:64] FLAG: --lock-file="" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798324 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798327 2550 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798331 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798336 2550 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798340 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798343 2550 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798346 2550 flags.go:64] FLAG: --logging-format="text" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798353 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798356 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798359 2550 flags.go:64] FLAG: --manifest-url="" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798363 2550 flags.go:64] FLAG: --manifest-url-header="" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798367 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798370 2550 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798375 2550 flags.go:64] FLAG: --max-pods="110" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798378 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798381 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798385 2550 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798388 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798391 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798394 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798398 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798405 2550 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798408 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798412 2550 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 00:08:23.806273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798415 2550 flags.go:64] FLAG: --pod-cidr="" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798418 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798424 2550 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798427 2550 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798431 2550 flags.go:64] FLAG: --pods-per-core="0" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798434 2550 flags.go:64] FLAG: --port="10250" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798438 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798441 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021b41f532a4e0bfe" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798444 2550 flags.go:64] FLAG: --qos-reserved="" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798447 2550 flags.go:64] FLAG: --read-only-port="10255" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798450 2550 flags.go:64] FLAG: --register-node="true" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798454 2550 flags.go:64] FLAG: --register-with-taints="" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798457 2550 flags.go:64] FLAG: --registry-burst="10" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798461 2550 flags.go:64] FLAG: --registry-qps="5" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798464 2550 flags.go:64] FLAG: --reserved-cpus="" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798468 2550 flags.go:64] FLAG: --reserved-memory="" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798473 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798476 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798480 2550 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798483 2550 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798486 2550 flags.go:64] FLAG: --runonce="false" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798489 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798492 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798496 2550 flags.go:64] FLAG: --seccomp-default="false" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798499 2550 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 00:08:23.806942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798502 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798505 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798508 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798512 2550 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798515 2550 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798519 2550 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798522 2550 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798526 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798529 2550 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798532 2550 flags.go:64] FLAG: --system-cgroups="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798535 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798541 2550 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798544 2550 flags.go:64] FLAG: --tls-cert-file="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798547 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798552 2550 flags.go:64] FLAG: --tls-min-version="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798555 2550 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798558 2550 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798561 2550 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798564 2550 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798567 2550 flags.go:64] FLAG: --v="2" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798571 2550 flags.go:64] FLAG: --version="false" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798579 2550 flags.go:64] FLAG: --vmodule="" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798583 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.798588 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798721 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 00:08:23.807611 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798725 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798728 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798732 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798735 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798739 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798743 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798746 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798749 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798752 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798755 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798757 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798760 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798763 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798766 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798769 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798772 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798775 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798778 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798781 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 00:08:23.808305 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798784 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798787 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798791 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798794 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798797 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798800 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798803 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798806 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798809 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798812 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798816 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798820 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798823 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798826 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798829 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798831 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798841 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798845 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798848 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798851 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 00:08:23.808828 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798854 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798857 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798860 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798863 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798866 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798869 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798872 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798875 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798878 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798882 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798887 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798890 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798893 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798897 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798901 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798904 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798907 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798910 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798913 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 00:08:23.809351 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798916 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798920 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798922 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798927 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798932 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798935 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798938 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798941 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798943 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798946 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798949 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798952 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798955 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798958 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798961 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798963 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798966 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798969 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798972 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798975 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 00:08:23.809934 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798978 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798981 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798984 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798986 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798989 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798992 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798995 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.798998 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799001 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799003 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799006 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799009 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799012 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799015 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799017 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799022 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799025 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799029 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799031 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 00:08:23.810467 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.799034 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.799716 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.808043 2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.808059 2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.808946 2550 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.808955 2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809013 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809019 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809023 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809026 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809029 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809033 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809036 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809038 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809043 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 00:08:23.810981 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809048 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809052 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809055 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809057 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809060 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809063 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809066 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809069 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809072 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809074 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809077 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809080 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809083 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809086 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809088 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809091 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809094 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809097 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809100 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809102 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 00:08:23.811394 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809107 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809110 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809113 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809116 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809118 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809121 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809125 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809127 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809130 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809134 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809136 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809139 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809142 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809145 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809148 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809151 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809154 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809157 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809160 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 00:08:23.811923 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809163 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809165 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809168 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809171 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809174 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809177 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809180 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809182 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809185 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809188 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809191 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809194 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809197 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809201 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809204 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809207 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809210 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809213 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809216 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809219 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 00:08:23.812413 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809222 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809225 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809228 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809231 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809234 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809236 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809239 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809242 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809245 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809249 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809253 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809256 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809260 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809263 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809266 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809269 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809271 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809274 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809277 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 00:08:23.812948 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809280 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809282 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809285 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809288 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809291 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809293 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809297 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809300 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809304 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809306 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809310 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809314 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.809320 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809441 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 00:08:23.813433 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809446 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809450 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809453 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809456 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809459 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809461 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809464 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809467 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809470 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809472 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809475 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809478 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809481 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809484 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809487 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809490 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809493 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809496 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809499 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809502 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 00:08:23.813862 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809504 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809507 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809510 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809513 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809516 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809519 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809521 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809525 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809528 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809531 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809534 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809537 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809540 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809543 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809547 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809551 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809555 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809558 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809561 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 00:08:23.814369 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809564 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809567 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809570 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809573 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809576 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809580 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809583 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809586 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809589 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809592 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809594 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809597 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809600 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809603 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809606 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809609 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809612 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809615 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809619 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 00:08:23.814872 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809636 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809641 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809647 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809651 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809654 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809657 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809660 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809663 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809666 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809668 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809671 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809674 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809677 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809680 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809683 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809685 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809688 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809691 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809694 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809696 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 00:08:23.815370 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809699 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809702 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809705 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809708 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809711 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809714 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809716 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809719 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809722 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809724 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809727 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809730 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809733 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809736 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809739 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809742 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809745 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809748 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809752 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 00:08:23.815892 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:23.809755 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 00:08:23.816394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.809760 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 00:08:23.816394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.809863 2550 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 00:08:23.816394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.813102 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 00:08:23.816394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.814733 2550 server.go:1019] "Starting client certificate rotation" Jul 29 00:08:23.816394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.814843 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 00:08:23.816394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.814886 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 00:08:23.817463 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.817449 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 00:08:23.821401 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.821377 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 00:08:23.834249 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.834230 2550 log.go:25] "Validated CRI v1 runtime API" Jul 29 00:08:23.836505 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.836488 2550 log.go:25] "Validated CRI v1 image API" Jul 29 00:08:23.838105 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.838089 2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 00:08:23.842738 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.842716 2550 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9c35ff6f-c96c-4efd-b8c1-6975a16e1aed:/dev/nvme0n1p3 cc78a67d-6882-4818-b3f6-73a4a4ded948:/dev/nvme0n1p4] Jul 29 00:08:23.842838 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.842737 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 00:08:23.848141 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.848018 2550 manager.go:216] Machine: {Timestamp:2026-07-29 00:08:23.846609888 +0000 UTC m=+0.365938551 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499994 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27f96d28435325c7721a88d805cbfa SystemUUID:ec27f96d-2843-5325-c772-1a88d805cbfa BootID:8d8a0eb9-0a28-42cd-acdd-9eb82c435c74 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:eb:e5:f8:5b:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:eb:e5:f8:5b:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:f6:e0:db:7b:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 00:08:23.848141 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.848132 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 00:08:23.848316 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.848249 2550 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 00:08:23.848353 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.848334 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 00:08:23.851377 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.851346 2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 00:08:23.851519 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.851380 2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-130.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 00:08:23.852240 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.852229 2550 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 00:08:23.852275 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.852243 2550 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 00:08:23.852275 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.852255 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 00:08:23.853099 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.853087 2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 00:08:23.855319 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.855307 2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 00:08:23.858642 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858616 2550 state_mem.go:36] "Initialized new in-memory state store" Jul 29 00:08:23.858779 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858767 2550 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 00:08:23.858849 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858805 2550 kubelet.go:486] "Attempting to sync node with API server" Jul 29 00:08:23.858849 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858821 2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 00:08:23.858849 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858842 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 00:08:23.858976 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858858 2550 kubelet.go:398] "Adding apiserver pod source" Jul 29 00:08:23.858976 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.858871 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 00:08:23.859293 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.859277 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 00:08:23.859359 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.859307 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 00:08:23.863130 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.863112 2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 00:08:23.865484 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.865470 2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 00:08:23.865545 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.865502 2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 00:08:23.867473 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867448 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867485 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867496 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867507 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867521 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867538 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867551 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 00:08:23.867557 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867561 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 00:08:23.867973 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867573 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 00:08:23.867973 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867591 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 00:08:23.867973 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867665 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 00:08:23.867973 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.867675 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 00:08:23.868601 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.868581 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 00:08:23.868717 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.868702 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 00:08:23.869891 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.869868 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9gvh" Jul 29 00:08:23.870283 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.870251 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 00:08:23.870424 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.870408 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 00:08:23.872767 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.872746 2550 server.go:1268] "Started kubelet" Jul 29 00:08:23.872871 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.872833 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 00:08:23.872949 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.872895 2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 00:08:23.873015 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.872975 2550 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 00:08:23.874111 ip-10-0-133-130 systemd[1]: Started Kubernetes Kubelet. Jul 29 00:08:23.874387 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.874370 2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 00:08:23.874760 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.874727 2550 server.go:310] "Adding debug handlers to kubelet server" Jul 29 00:08:23.877657 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.877635 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9gvh" Jul 29 00:08:23.878976 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.878957 2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-130.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 00:08:23.879976 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.878990 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-130.ec2.internal.18c69a11e0a00d60 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-130.ec2.internal,UID:ip-10-0-133-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-130.ec2.internal,},FirstTimestamp:2026-07-29 00:08:23.872687456 +0000 UTC m=+0.392016096,LastTimestamp:2026-07-29 00:08:23.872687456 +0000 UTC m=+0.392016096,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-130.ec2.internal,}" Jul 29 00:08:23.880720 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.880694 2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 00:08:23.886449 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.886430 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 00:08:23.886449 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.886444 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 00:08:23.886681 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.886659 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:23.887336 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887305 2550 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 00:08:23.887421 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887346 2550 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 00:08:23.887421 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887319 2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 00:08:23.887529 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887449 2550 reconstruct.go:97] "Volume reconstruction finished" Jul 29 00:08:23.887529 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887458 2550 reconciler.go:29] "Reconciler: start to sync state" Jul 29 00:08:23.887703 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887687 2550 factory.go:55] Registering systemd factory Jul 29 00:08:23.887703 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887704 2550 factory.go:223] Registration of the systemd container factory successfully Jul 29 00:08:23.887986 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887969 2550 factory.go:153] Registering CRI-O factory Jul 29 00:08:23.887986 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.887988 2550 factory.go:223] Registration of the crio container factory successfully Jul 29 00:08:23.888095 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.888077 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 00:08:23.888144 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.888104 2550 factory.go:103] Registering Raw factory Jul 29 00:08:23.888144 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.888120 2550 manager.go:1196] Started watching for new ooms in manager Jul 29 00:08:23.888882 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.888849 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 00:08:23.889015 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.888846 2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 00:08:23.889393 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.889374 2550 manager.go:349] Starting recovery of all containers Jul 29 00:08:23.900383 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.900211 2550 manager.go:354] Recovery completed Jul 29 00:08:23.905514 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.905497 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:23.907338 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.907320 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:23.907395 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.907352 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:23.907395 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.907363 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:23.907948 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.907931 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 00:08:23.907948 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.907956 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:23.908076 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.907956 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 00:08:23.908076 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.908005 2550 state_mem.go:36] "Initialized new in-memory state store" Jul 29 00:08:23.908792 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.908773 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:23.908876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.908811 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:23.908876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.908828 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:23.910005 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.909991 2550 policy_none.go:49] "None policy: Start" Jul 29 00:08:23.910063 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.910008 2550 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 00:08:23.910063 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.910020 2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 00:08:23.911364 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.911352 2550 policy_none.go:47] "Start" Jul 29 00:08:23.950274 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950224 2550 manager.go:337] "Starting Device Plugin manager" Jul 29 00:08:23.950274 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.950264 2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 00:08:23.950411 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950278 2550 server.go:87] "Starting device plugin registration server" Jul 29 00:08:23.950538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950525 2550 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 00:08:23.950616 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950538 2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 00:08:23.950688 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950631 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 00:08:23.950744 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950722 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 00:08:23.950794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:23.950748 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 00:08:23.951259 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.951242 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 00:08:23.951349 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:23.951285 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.052683 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.052655 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:24.054303 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.053973 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:24.054303 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.054002 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:24.054303 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.054014 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:24.054303 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.054039 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.063079 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.063062 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.063132 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.063087 2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-130.ec2.internal\": node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.077358 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.077334 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.108791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.108762 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 00:08:24.109972 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.109947 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 00:08:24.110044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.109999 2550 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 00:08:24.110044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.110028 2550 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 00:08:24.110113 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.110073 2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 00:08:24.112451 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.112424 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 00:08:24.181201 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.181176 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.211844 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.211781 2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal"] Jul 29 00:08:24.211912 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.211864 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:24.213989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.213972 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:24.214066 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.214003 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:24.214066 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.214014 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:24.215635 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.215614 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:24.215759 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.215744 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.215834 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.215774 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:24.216406 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.216391 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:24.216486 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.216421 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:24.216486 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.216446 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:24.216486 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.216452 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:24.216486 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.216481 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:24.216643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.216502 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:24.217859 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.217845 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.217912 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.217870 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 00:08:24.218552 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.218537 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientMemory" Jul 29 00:08:24.218643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.218560 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 00:08:24.218643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.218574 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeHasSufficientPID" Jul 29 00:08:24.236191 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.236168 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-130.ec2.internal\" not found" node="ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.239748 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.239733 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-130.ec2.internal\" not found" node="ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.282076 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.282053 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.288642 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.288618 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d59c7f673952f894c1943cf0c2fc197-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal\" (UID: \"2d59c7f673952f894c1943cf0c2fc197\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.288734 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.288655 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d59c7f673952f894c1943cf0c2fc197-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal\" (UID: \"2d59c7f673952f894c1943cf0c2fc197\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.288734 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.288683 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59375038913e807bad244432c11c8feb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-130.ec2.internal\" (UID: \"59375038913e807bad244432c11c8feb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.383507 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.383477 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.389005 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.388987 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59375038913e807bad244432c11c8feb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-130.ec2.internal\" (UID: \"59375038913e807bad244432c11c8feb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.389071 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.389013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d59c7f673952f894c1943cf0c2fc197-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal\" (UID: \"2d59c7f673952f894c1943cf0c2fc197\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.389071 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.389042 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d59c7f673952f894c1943cf0c2fc197-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal\" (UID: \"2d59c7f673952f894c1943cf0c2fc197\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.389179 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.389071 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d59c7f673952f894c1943cf0c2fc197-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal\" (UID: \"2d59c7f673952f894c1943cf0c2fc197\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.389179 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.389103 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59375038913e807bad244432c11c8feb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-130.ec2.internal\" (UID: \"59375038913e807bad244432c11c8feb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.389179 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.389110 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d59c7f673952f894c1943cf0c2fc197-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal\" (UID: \"2d59c7f673952f894c1943cf0c2fc197\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.488154 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.488074 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.541428 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.541387 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.546101 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.545834 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" Jul 29 00:08:24.588744 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.588717 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.693189 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.693162 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.793356 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.793286 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.815081 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.815059 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 00:08:24.815200 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.815182 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 00:08:24.884315 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.884277 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 00:03:24 +0000 UTC" deadline="2028-01-01 04:56:31.853468178 +0000 UTC" Jul 29 00:08:24.884315 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.884310 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12508h48m6.969161167s" Jul 29 00:08:24.893371 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.893346 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.993442 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:24.993407 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:24.994731 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:24.994716 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 00:08:25.005006 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.004986 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 00:08:25.093722 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:25.093649 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-130.ec2.internal\" not found" Jul 29 00:08:25.191616 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.191587 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 00:08:25.220265 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:25.220232 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59375038913e807bad244432c11c8feb.slice/crio-ecb2d11f5b99e2deaeef7aecf3da4f4e054513bbbafad2921098cc0b30a5f5db WatchSource:0}: Error finding container ecb2d11f5b99e2deaeef7aecf3da4f4e054513bbbafad2921098cc0b30a5f5db: Status 404 returned error can't find the container with id ecb2d11f5b99e2deaeef7aecf3da4f4e054513bbbafad2921098cc0b30a5f5db Jul 29 00:08:25.222861 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:25.222829 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d59c7f673952f894c1943cf0c2fc197.slice/crio-89fe0a1fcb29b30ac1f53e6cb514f77a2c678b8127ffc975ab174d5a4cb0d153 WatchSource:0}: Error finding container 89fe0a1fcb29b30ac1f53e6cb514f77a2c678b8127ffc975ab174d5a4cb0d153: Status 404 returned error can't find the container with id 89fe0a1fcb29b30ac1f53e6cb514f77a2c678b8127ffc975ab174d5a4cb0d153 Jul 29 00:08:25.228960 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.228943 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 00:08:25.287235 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.287198 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" Jul 29 00:08:25.298668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.298650 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 00:08:25.299743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.299730 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" Jul 29 00:08:25.322424 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.322410 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 00:08:25.845830 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.845802 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 00:08:25.862536 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.862507 2550 apiserver.go:52] "Watching apiserver" Jul 29 00:08:25.870887 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.870861 2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 00:08:25.871345 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.871322 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal","openshift-network-diagnostics/network-check-target-2xj27","openshift-network-operator/iptables-alerter-2lvtr","openshift-ovn-kubernetes/ovnkube-node-nxf2t","kube-system/konnectivity-agent-kgd76","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q","openshift-cluster-node-tuning-operator/tuned-vxk9d","openshift-image-registry/node-ca-cnlvt","openshift-multus/multus-additional-cni-plugins-9n556","openshift-multus/multus-xwf54","openshift-multus/network-metrics-daemon-xk2g8","kube-system/global-pull-secret-syncer-x7qbk","kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal","openshift-dns/node-resolver-xqbv9"] Jul 29 00:08:25.873004 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.872983 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.874283 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.874261 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:25.874401 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:25.874359 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:25.875877 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.875627 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:25.875877 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.875656 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 00:08:25.875877 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.875765 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.876285 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.876267 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 00:08:25.876595 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.876552 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tg49g\"" Jul 29 00:08:25.876814 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.876599 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.877781 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.877761 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.878499 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.878477 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nvch9\"" Jul 29 00:08:25.878608 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.878575 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.878739 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.878719 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.879012 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.878979 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 00:08:25.879012 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.878990 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:25.880791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.880524 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.880791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.880572 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.880791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.880587 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.880791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.880656 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9b7zq\"" Jul 29 00:08:25.881053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.880538 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 00:08:25.881053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.880982 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 00:08:25.881053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.881029 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 00:08:25.882349 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.882105 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 00:08:25.882548 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.882529 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 00:08:25.882831 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.882815 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6dchb\"" Jul 29 00:08:25.883127 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.882820 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 00:08:25.883850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.883829 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 00:08:25.884068 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.884048 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.884152 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.884068 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zt4gk\"" Jul 29 00:08:25.884302 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.884286 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.884390 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.884371 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:25.885591 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.885571 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.886845 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.886824 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lrwgv\"" Jul 29 00:08:25.886945 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.886849 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.886945 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.886854 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.887784 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.887763 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 00:08:25.887884 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.887854 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:25.887958 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:25.887934 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:25.888051 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.888033 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.888296 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.888279 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.888375 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.888330 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rrjsf\"" Jul 29 00:08:25.889283 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.889265 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:25.889381 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:25.889330 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:25.891118 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.891097 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:25.892798 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.892778 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:25.893868 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.893850 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 00:08:25.893963 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.893850 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 00:08:25.893963 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.893907 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5mvkx\"" Jul 29 00:08:25.894088 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.894005 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 00:08:25.895123 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.895103 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 00:08:25.895467 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.895444 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 00:08:25.895723 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.895699 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gnk4m\"" Jul 29 00:08:25.897703 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897681 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krzdz\" (UniqueName: \"kubernetes.io/projected/04824004-3845-42c8-9515-b6232e590423-kube-api-access-krzdz\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:25.897813 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897713 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-sys-fs\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.897813 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897742 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nkx\" (UniqueName: \"kubernetes.io/projected/0ee6572d-bd29-4d16-8065-f5aef82bfe38-kube-api-access-z2nkx\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:25.897813 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897766 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-kubelet\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.897813 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897791 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-systemd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.897813 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897809 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-var-lib-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897823 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-tuned\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897843 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-etc-kubernetes\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897866 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-ovn\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897906 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-cni-bin\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897959 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-modprobe-d\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.897991 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysctl-d\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898024 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-k8s-cni-cncf-io\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898051 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee6572d-bd29-4d16-8065-f5aef82bfe38-host-slash\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:25.898080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898076 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898109 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb77e36d-b896-458b-8dab-8bac9eabde23-kubelet-config\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898161 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-os-release\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898203 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-log-socket\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898227 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysctl-conf\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898248 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-conf-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898275 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-multus-certs\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898317 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898377 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3805e8fb-5970-4290-9b9f-ed9edbbb33da-agent-certs\") pod \"konnectivity-agent-kgd76\" (UID: \"3805e8fb-5970-4290-9b9f-ed9edbbb33da\") " pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898412 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-systemd\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898439 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-lib-modules\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.898538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898507 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6b6q\" (UniqueName: \"kubernetes.io/projected/dcb5bf61-144c-4e23-8208-33f50c1e26bb-kube-api-access-g6b6q\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898562 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-registration-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898610 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb77e36d-b896-458b-8dab-8bac9eabde23-dbus\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898633 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4735ee1-01e3-46ec-a60a-57b585630928-cni-binary-copy\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898658 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898686 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee6572d-bd29-4d16-8065-f5aef82bfe38-iptables-alerter-script\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898710 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-run-netns\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898729 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d46c1aa8-c028-4f3c-b959-153572e690f8-hosts-file\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898753 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysconfig\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898835 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-slash\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898877 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-cni-bin\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898919 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-kubelet\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898945 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk47r\" (UniqueName: \"kubernetes.io/projected/a4735ee1-01e3-46ec-a60a-57b585630928-kube-api-access-qk47r\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.898981 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899003 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-host\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899029 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-socket-dir-parent\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899074 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899056 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4735ee1-01e3-46ec-a60a-57b585630928-multus-daemon-config\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899086 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-etc-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899110 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-cni-netd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899155 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-env-overrides\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899177 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-ovnkube-script-lib\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899205 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-device-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899233 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-cni-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899252 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-cnibin\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899267 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-systemd-units\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899282 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899306 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d46c1aa8-c028-4f3c-b959-153572e690f8-tmp-dir\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899329 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-run\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899352 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-var-lib-kubelet\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899383 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-system-cni-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899467 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-cni-multus\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899501 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-ovnkube-config\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899528 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b82678a6-566f-41f2-bf14-c5c653e69136-ovn-node-metrics-cert\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.899749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899552 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3805e8fb-5970-4290-9b9f-ed9edbbb33da-konnectivity-ca\") pod \"konnectivity-agent-kgd76\" (UID: \"3805e8fb-5970-4290-9b9f-ed9edbbb33da\") " pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899591 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-socket-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899619 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-node-log\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899643 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf7qd\" (UniqueName: \"kubernetes.io/projected/d46c1aa8-c028-4f3c-b959-153572e690f8-kube-api-access-tf7qd\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899666 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-kubernetes\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899691 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899715 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-netns\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899739 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-sys\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899765 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899788 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcb5bf61-144c-4e23-8208-33f50c1e26bb-tmp\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899812 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57dcr\" (UniqueName: \"kubernetes.io/projected/ab9b5376-e06d-4bc9-b979-08306a275cc1-kube-api-access-57dcr\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899837 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899869 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-hostroot\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:25.900603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.899903 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6dvd\" (UniqueName: \"kubernetes.io/projected/b82678a6-566f-41f2-bf14-c5c653e69136-kube-api-access-c6dvd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:25.901320 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.900796 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 00:08:25.927504 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.927480 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jkxl" Jul 29 00:08:25.936512 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.935868 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jkxl" Jul 29 00:08:25.988220 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:25.988197 2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 00:08:26.000158 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000125 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-hostroot\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.000309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000184 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6dvd\" (UniqueName: \"kubernetes.io/projected/b82678a6-566f-41f2-bf14-c5c653e69136-kube-api-access-c6dvd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.000309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000215 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krzdz\" (UniqueName: \"kubernetes.io/projected/04824004-3845-42c8-9515-b6232e590423-kube-api-access-krzdz\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:26.000309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000241 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-sys-fs\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.000309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000273 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.000309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000302 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nkx\" (UniqueName: \"kubernetes.io/projected/0ee6572d-bd29-4d16-8065-f5aef82bfe38-kube-api-access-z2nkx\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000327 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-kubelet\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000351 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-systemd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000377 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-var-lib-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000402 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-tuned\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000425 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-etc-kubernetes\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000448 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-ovn\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000471 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-cni-bin\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000498 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-modprobe-d\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000522 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysctl-d\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.000560 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000546 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-k8s-cni-cncf-io\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000570 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee6572d-bd29-4d16-8065-f5aef82bfe38-host-slash\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000598 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000646 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb77e36d-b896-458b-8dab-8bac9eabde23-kubelet-config\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000672 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-os-release\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000696 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-log-socket\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000725 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysctl-conf\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000751 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-conf-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000777 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-multus-certs\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000805 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000836 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3805e8fb-5970-4290-9b9f-ed9edbbb33da-agent-certs\") pod \"konnectivity-agent-kgd76\" (UID: \"3805e8fb-5970-4290-9b9f-ed9edbbb33da\") " pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000859 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-systemd\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000885 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-lib-modules\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000915 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6b6q\" (UniqueName: \"kubernetes.io/projected/dcb5bf61-144c-4e23-8208-33f50c1e26bb-kube-api-access-g6b6q\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000941 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-registration-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000965 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb77e36d-b896-458b-8dab-8bac9eabde23-dbus\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:26.001008 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.000990 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4735ee1-01e3-46ec-a60a-57b585630928-cni-binary-copy\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001017 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001045 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee6572d-bd29-4d16-8065-f5aef82bfe38-iptables-alerter-script\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001074 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-run-netns\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001101 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d46c1aa8-c028-4f3c-b959-153572e690f8-hosts-file\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001130 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysconfig\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001160 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00f2508a-589e-4107-9fb1-d787a989bf56-serviceca\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001190 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-system-cni-dir\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001218 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-slash\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001253 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-cni-bin\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001283 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-kubelet\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001316 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk47r\" (UniqueName: \"kubernetes.io/projected/a4735ee1-01e3-46ec-a60a-57b585630928-kube-api-access-qk47r\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001343 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001367 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-host\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001400 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001429 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-socket-dir-parent\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001455 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4735ee1-01e3-46ec-a60a-57b585630928-multus-daemon-config\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.001807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001481 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-etc-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001507 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-cni-netd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001537 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-env-overrides\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001562 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-ovnkube-script-lib\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001590 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-device-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001617 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00f2508a-589e-4107-9fb1-d787a989bf56-host\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001658 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-cni-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001684 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-cnibin\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001691 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-sys-fs\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001710 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-systemd-units\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001740 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001767 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d46c1aa8-c028-4f3c-b959-153572e690f8-tmp-dir\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001792 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-run\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001821 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-var-lib-kubelet\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001848 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-os-release\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001876 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-system-cni-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001906 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-cni-multus\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.002645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001932 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-ovnkube-config\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001958 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b82678a6-566f-41f2-bf14-c5c653e69136-ovn-node-metrics-cert\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001975 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-kubelet\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001985 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3805e8fb-5970-4290-9b9f-ed9edbbb33da-konnectivity-ca\") pod \"konnectivity-agent-kgd76\" (UID: \"3805e8fb-5970-4290-9b9f-ed9edbbb33da\") " pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002031 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-systemd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002065 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-socket-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002100 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-node-log\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002130 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf7qd\" (UniqueName: \"kubernetes.io/projected/d46c1aa8-c028-4f3c-b959-153572e690f8-kube-api-access-tf7qd\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002159 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-kubernetes\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002188 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002224 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002256 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-netns\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002296 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-sys\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002324 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002351 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002380 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcb5bf61-144c-4e23-8208-33f50c1e26bb-tmp\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002414 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57dcr\" (UniqueName: \"kubernetes.io/projected/ab9b5376-e06d-4bc9-b979-08306a275cc1-kube-api-access-57dcr\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.003490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002537 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002566 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ch7\" (UniqueName: \"kubernetes.io/projected/00f2508a-589e-4107-9fb1-d787a989bf56-kube-api-access-t8ch7\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002587 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3805e8fb-5970-4290-9b9f-ed9edbbb33da-konnectivity-ca\") pod \"konnectivity-agent-kgd76\" (UID: \"3805e8fb-5970-4290-9b9f-ed9edbbb33da\") " pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002663 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-var-lib-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002704 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-etc-kubernetes\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002755 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-ovn\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002802 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-cni-bin\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002803 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-socket-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002864 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-node-log\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002992 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-modprobe-d\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003082 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysctl-d\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003107 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-kubernetes\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003138 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-k8s-cni-cncf-io\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.003210 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003225 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.003272 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:26.503251287 +0000 UTC m=+3.022579919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003279 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb77e36d-b896-458b-8dab-8bac9eabde23-kubelet-config\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:26.004357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003347 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-os-release\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003392 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-log-socket\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003518 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysctl-conf\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003522 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-netns\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003569 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-run-multus-certs\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003574 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-conf-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003644 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-sys\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003705 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-host\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003774 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003866 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-systemd\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.003903 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.003962 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:26.503944395 +0000 UTC m=+3.023273023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004012 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee6572d-bd29-4d16-8065-f5aef82bfe38-host-slash\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004079 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d46c1aa8-c028-4f3c-b959-153572e690f8-hosts-file\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004210 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-lib-modules\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004336 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-sysconfig\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001129 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-hostroot\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004418 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-slash\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.005221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004465 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-cni-bin\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004506 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-registration-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004521 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-kubelet\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004680 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb77e36d-b896-458b-8dab-8bac9eabde23-dbus\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.004802 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-run-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.005372 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4735ee1-01e3-46ec-a60a-57b585630928-cni-binary-copy\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.005374 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee6572d-bd29-4d16-8065-f5aef82bfe38-iptables-alerter-script\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.005462 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-run-netns\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.001068 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.005827 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-cnibin\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.006155 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.005906 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-socket-dir-parent\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.006615 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.006375 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4735ee1-01e3-46ec-a60a-57b585630928-multus-daemon-config\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.006615 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.006444 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-etc-openvswitch\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.006615 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.006493 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-cni-netd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.007135 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab9b5376-e06d-4bc9-b979-08306a275cc1-device-dir\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.007293 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-systemd-units\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.007350 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.007649 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d46c1aa8-c028-4f3c-b959-153572e690f8-tmp-dir\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.007731 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-run\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.007786 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcb5bf61-144c-4e23-8208-33f50c1e26bb-var-lib-kubelet\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.008757 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-system-cni-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.008816 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-host-var-lib-cni-multus\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.008891 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4735ee1-01e3-46ec-a60a-57b585630928-multus-cni-dir\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.009576 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcb5bf61-144c-4e23-8208-33f50c1e26bb-etc-tuned\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.009649 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-env-overrides\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.002593 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cnibin\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.009710 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7hq\" (UniqueName: \"kubernetes.io/projected/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-kube-api-access-ps7hq\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.010373 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-ovnkube-config\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.010655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.010550 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcb5bf61-144c-4e23-8208-33f50c1e26bb-tmp\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.012044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.003617 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b82678a6-566f-41f2-bf14-c5c653e69136-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.012044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.011302 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b82678a6-566f-41f2-bf14-c5c653e69136-ovnkube-script-lib\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.012044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.011584 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b82678a6-566f-41f2-bf14-c5c653e69136-ovn-node-metrics-cert\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.012213 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.012056 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:26.012213 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.012083 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:26.012213 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.012099 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:26.012213 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.012195 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:26.5121683 +0000 UTC m=+3.031496934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:26.013398 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.012960 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3805e8fb-5970-4290-9b9f-ed9edbbb33da-agent-certs\") pod \"konnectivity-agent-kgd76\" (UID: \"3805e8fb-5970-4290-9b9f-ed9edbbb33da\") " pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:26.015290 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.015205 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6dvd\" (UniqueName: \"kubernetes.io/projected/b82678a6-566f-41f2-bf14-c5c653e69136-kube-api-access-c6dvd\") pod \"ovnkube-node-nxf2t\" (UID: \"b82678a6-566f-41f2-bf14-c5c653e69136\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.015869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.015844 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nkx\" (UniqueName: \"kubernetes.io/projected/0ee6572d-bd29-4d16-8065-f5aef82bfe38-kube-api-access-z2nkx\") pod \"iptables-alerter-2lvtr\" (UID: \"0ee6572d-bd29-4d16-8065-f5aef82bfe38\") " pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.016354 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.016331 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krzdz\" (UniqueName: \"kubernetes.io/projected/04824004-3845-42c8-9515-b6232e590423-kube-api-access-krzdz\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:26.016975 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.016953 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf7qd\" (UniqueName: \"kubernetes.io/projected/d46c1aa8-c028-4f3c-b959-153572e690f8-kube-api-access-tf7qd\") pod \"node-resolver-xqbv9\" (UID: \"d46c1aa8-c028-4f3c-b959-153572e690f8\") " pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.017476 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.017453 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57dcr\" (UniqueName: \"kubernetes.io/projected/ab9b5376-e06d-4bc9-b979-08306a275cc1-kube-api-access-57dcr\") pod \"aws-ebs-csi-driver-node-k2m7q\" (UID: \"ab9b5376-e06d-4bc9-b979-08306a275cc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.017723 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.017701 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk47r\" (UniqueName: \"kubernetes.io/projected/a4735ee1-01e3-46ec-a60a-57b585630928-kube-api-access-qk47r\") pod \"multus-xwf54\" (UID: \"a4735ee1-01e3-46ec-a60a-57b585630928\") " pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.018402 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.018367 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6b6q\" (UniqueName: \"kubernetes.io/projected/dcb5bf61-144c-4e23-8208-33f50c1e26bb-kube-api-access-g6b6q\") pod \"tuned-vxk9d\" (UID: \"dcb5bf61-144c-4e23-8208-33f50c1e26bb\") " pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.110617 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110535 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00f2508a-589e-4107-9fb1-d787a989bf56-serviceca\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.110617 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110588 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-system-cni-dir\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110636 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110669 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00f2508a-589e-4107-9fb1-d787a989bf56-host\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110699 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-os-release\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110745 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110775 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110813 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ch7\" (UniqueName: \"kubernetes.io/projected/00f2508a-589e-4107-9fb1-d787a989bf56-kube-api-access-t8ch7\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.110850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110839 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cnibin\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.111203 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110864 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7hq\" (UniqueName: \"kubernetes.io/projected/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-kube-api-access-ps7hq\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.111203 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.110915 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.111203 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.111157 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00f2508a-589e-4107-9fb1-d787a989bf56-serviceca\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.111575 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.111536 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.111738 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.111717 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.112533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.111947 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.112533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.111987 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cnibin\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.112533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.112015 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-system-cni-dir\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.112533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.112251 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00f2508a-589e-4107-9fb1-d787a989bf56-host\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.112533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.112334 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-os-release\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.112533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.112454 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.117324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.117277 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" event={"ID":"2d59c7f673952f894c1943cf0c2fc197","Type":"ContainerStarted","Data":"89fe0a1fcb29b30ac1f53e6cb514f77a2c678b8127ffc975ab174d5a4cb0d153"} Jul 29 00:08:26.118878 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.118853 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" event={"ID":"59375038913e807bad244432c11c8feb","Type":"ContainerStarted","Data":"ecb2d11f5b99e2deaeef7aecf3da4f4e054513bbbafad2921098cc0b30a5f5db"} Jul 29 00:08:26.128163 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.128135 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7hq\" (UniqueName: \"kubernetes.io/projected/dd40ef28-aae4-4d1b-81e4-9124cc883ba5-kube-api-access-ps7hq\") pod \"multus-additional-cni-plugins-9n556\" (UID: \"dd40ef28-aae4-4d1b-81e4-9124cc883ba5\") " pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.129203 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.129178 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ch7\" (UniqueName: \"kubernetes.io/projected/00f2508a-589e-4107-9fb1-d787a989bf56-kube-api-access-t8ch7\") pod \"node-ca-cnlvt\" (UID: \"00f2508a-589e-4107-9fb1-d787a989bf56\") " pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.187672 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.187638 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xwf54" Jul 29 00:08:26.197129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.197103 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2lvtr" Jul 29 00:08:26.207354 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.207327 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:26.212901 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.212877 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:26.221384 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.221359 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" Jul 29 00:08:26.231657 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.231635 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xqbv9" Jul 29 00:08:26.239134 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.239111 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" Jul 29 00:08:26.248112 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.248092 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnlvt" Jul 29 00:08:26.254237 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.254215 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n556" Jul 29 00:08:26.514379 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.514287 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:26.514379 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.514347 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:26.514629 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.514407 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:26.514629 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514466 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:26.514629 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514531 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:26.514629 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514550 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:26.514629 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514562 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:26.514875 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514534 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:27.514515494 +0000 UTC m=+4.033844126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:26.514875 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514702 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:26.514875 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514720 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:27.514686191 +0000 UTC m=+4.034014832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:26.514875 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:26.514745 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:27.514731715 +0000 UTC m=+4.034060340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:26.938146 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.938047 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 00:03:26 +0000 UTC" deadline="2028-04-11 15:06:16.941627718 +0000 UTC" Jul 29 00:08:26.938146 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:26.938100 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14942h57m50.003532059s" Jul 29 00:08:27.111318 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.111284 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:27.111484 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.111401 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:27.111484 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.111460 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:27.111586 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.111555 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:27.251682 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.251647 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4735ee1_01e3_46ec_a60a_57b585630928.slice/crio-11a29bc574b9ec5251d14c2fc2b143ba9a55c7f48f1614d81d557e7bb607322a WatchSource:0}: Error finding container 11a29bc574b9ec5251d14c2fc2b143ba9a55c7f48f1614d81d557e7bb607322a: Status 404 returned error can't find the container with id 11a29bc574b9ec5251d14c2fc2b143ba9a55c7f48f1614d81d557e7bb607322a Jul 29 00:08:27.253512 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.253485 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46c1aa8_c028_4f3c_b959_153572e690f8.slice/crio-54a3cfb020b8eaaf7864795e762ea2dca4b574d990946694b9b8551d9c53418d WatchSource:0}: Error finding container 54a3cfb020b8eaaf7864795e762ea2dca4b574d990946694b9b8551d9c53418d: Status 404 returned error can't find the container with id 54a3cfb020b8eaaf7864795e762ea2dca4b574d990946694b9b8551d9c53418d Jul 29 00:08:27.257210 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.257148 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82678a6_566f_41f2_bf14_c5c653e69136.slice/crio-cdeaa41b9d009b50ca87387919dd2685e6005858463a9c853ee935be467f8ce4 WatchSource:0}: Error finding container cdeaa41b9d009b50ca87387919dd2685e6005858463a9c853ee935be467f8ce4: Status 404 returned error can't find the container with id cdeaa41b9d009b50ca87387919dd2685e6005858463a9c853ee935be467f8ce4 Jul 29 00:08:27.258117 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.258085 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb5bf61_144c_4e23_8208_33f50c1e26bb.slice/crio-e3c07af1cc414293c5484163a110e56e80af7edeafa2dbc82f4c4cc3268cfb78 WatchSource:0}: Error finding container e3c07af1cc414293c5484163a110e56e80af7edeafa2dbc82f4c4cc3268cfb78: Status 404 returned error can't find the container with id e3c07af1cc414293c5484163a110e56e80af7edeafa2dbc82f4c4cc3268cfb78 Jul 29 00:08:27.262545 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.261100 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3805e8fb_5970_4290_9b9f_ed9edbbb33da.slice/crio-d07fd16c861a07cd7c1f42f38cfff19da22c1479c59f5b4a6ce8a420ba40e3ab WatchSource:0}: Error finding container d07fd16c861a07cd7c1f42f38cfff19da22c1479c59f5b4a6ce8a420ba40e3ab: Status 404 returned error can't find the container with id d07fd16c861a07cd7c1f42f38cfff19da22c1479c59f5b4a6ce8a420ba40e3ab Jul 29 00:08:27.264262 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.264238 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9b5376_e06d_4bc9_b979_08306a275cc1.slice/crio-919454226b17753b966e85a19760e7a93337683188122923e782c062a9fb95c2 WatchSource:0}: Error finding container 919454226b17753b966e85a19760e7a93337683188122923e782c062a9fb95c2: Status 404 returned error can't find the container with id 919454226b17753b966e85a19760e7a93337683188122923e782c062a9fb95c2 Jul 29 00:08:27.266044 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.265948 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd40ef28_aae4_4d1b_81e4_9124cc883ba5.slice/crio-769eb9c6669934ace5dda22817abe5f835bdf4bdd2cd5c2bdb2b11ceb0a24916 WatchSource:0}: Error finding container 769eb9c6669934ace5dda22817abe5f835bdf4bdd2cd5c2bdb2b11ceb0a24916: Status 404 returned error can't find the container with id 769eb9c6669934ace5dda22817abe5f835bdf4bdd2cd5c2bdb2b11ceb0a24916 Jul 29 00:08:27.267486 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.267464 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee6572d_bd29_4d16_8065_f5aef82bfe38.slice/crio-6858baec7c89cb26b931ed34fc2d7379a74841de54cfa8ea70abce6cac48eac6 WatchSource:0}: Error finding container 6858baec7c89cb26b931ed34fc2d7379a74841de54cfa8ea70abce6cac48eac6: Status 404 returned error can't find the container with id 6858baec7c89cb26b931ed34fc2d7379a74841de54cfa8ea70abce6cac48eac6 Jul 29 00:08:27.268517 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:08:27.268492 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f2508a_589e_4107_9fb1_d787a989bf56.slice/crio-2426dfdc681b8697d7f12452058bd772c7aba407f313c49fc2d4123ea0d666e4 WatchSource:0}: Error finding container 2426dfdc681b8697d7f12452058bd772c7aba407f313c49fc2d4123ea0d666e4: Status 404 returned error can't find the container with id 2426dfdc681b8697d7f12452058bd772c7aba407f313c49fc2d4123ea0d666e4 Jul 29 00:08:27.522253 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.522224 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:27.522369 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.522269 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:27.522369 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.522301 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:27.522480 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522369 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:27.522480 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522383 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:27.522480 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522434 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:29.522419072 +0000 UTC m=+6.041747698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:27.522480 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522449 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:29.522441823 +0000 UTC m=+6.041770448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:27.522480 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522463 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:27.522723 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522486 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:27.522723 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522501 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:27.522723 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:27.522563 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:29.522543978 +0000 UTC m=+6.041872623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:27.938772 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.938722 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 00:03:26 +0000 UTC" deadline="2028-02-06 21:04:46.173171752 +0000 UTC" Jul 29 00:08:27.938772 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:27.938769 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13388h56m18.23440985s" Jul 29 00:08:28.112290 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.111761 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:28.112290 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:28.111898 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:28.126972 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.126491 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" event={"ID":"ab9b5376-e06d-4bc9-b979-08306a275cc1","Type":"ContainerStarted","Data":"919454226b17753b966e85a19760e7a93337683188122923e782c062a9fb95c2"} Jul 29 00:08:28.129272 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.129213 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kgd76" event={"ID":"3805e8fb-5970-4290-9b9f-ed9edbbb33da","Type":"ContainerStarted","Data":"d07fd16c861a07cd7c1f42f38cfff19da22c1479c59f5b4a6ce8a420ba40e3ab"} Jul 29 00:08:28.143116 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.143035 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xwf54" event={"ID":"a4735ee1-01e3-46ec-a60a-57b585630928","Type":"ContainerStarted","Data":"11a29bc574b9ec5251d14c2fc2b143ba9a55c7f48f1614d81d557e7bb607322a"} Jul 29 00:08:28.155677 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.154998 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" event={"ID":"59375038913e807bad244432c11c8feb","Type":"ContainerStarted","Data":"b40285dc4c0d5a942945e1ebee307527e593a19430d6b07c486777d8afef8f79"} Jul 29 00:08:28.174358 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.174330 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2lvtr" event={"ID":"0ee6572d-bd29-4d16-8065-f5aef82bfe38","Type":"ContainerStarted","Data":"6858baec7c89cb26b931ed34fc2d7379a74841de54cfa8ea70abce6cac48eac6"} Jul 29 00:08:28.179648 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.179615 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"cdeaa41b9d009b50ca87387919dd2685e6005858463a9c853ee935be467f8ce4"} Jul 29 00:08:28.188706 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.188586 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xqbv9" event={"ID":"d46c1aa8-c028-4f3c-b959-153572e690f8","Type":"ContainerStarted","Data":"54a3cfb020b8eaaf7864795e762ea2dca4b574d990946694b9b8551d9c53418d"} Jul 29 00:08:28.192556 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.192526 2550 generic.go:356] "Generic (PLEG): container finished" podID="2d59c7f673952f894c1943cf0c2fc197" containerID="bcacc3527e51cccdc70c9c3066ea2d6977f85ea34f7cd01428cb97bc8788199f" exitCode=0 Jul 29 00:08:28.192845 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.192813 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" event={"ID":"2d59c7f673952f894c1943cf0c2fc197","Type":"ContainerDied","Data":"bcacc3527e51cccdc70c9c3066ea2d6977f85ea34f7cd01428cb97bc8788199f"} Jul 29 00:08:28.203516 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.203450 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnlvt" event={"ID":"00f2508a-589e-4107-9fb1-d787a989bf56","Type":"ContainerStarted","Data":"2426dfdc681b8697d7f12452058bd772c7aba407f313c49fc2d4123ea0d666e4"} Jul 29 00:08:28.208941 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.207540 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-130.ec2.internal" podStartSLOduration=3.207521261 podStartE2EDuration="3.207521261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:28.172008251 +0000 UTC m=+4.691336902" watchObservedRunningTime="2026-07-29 00:08:28.207521261 +0000 UTC m=+4.726849905" Jul 29 00:08:28.212797 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.212771 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerStarted","Data":"769eb9c6669934ace5dda22817abe5f835bdf4bdd2cd5c2bdb2b11ceb0a24916"} Jul 29 00:08:28.228087 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:28.227749 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" event={"ID":"dcb5bf61-144c-4e23-8208-33f50c1e26bb","Type":"ContainerStarted","Data":"e3c07af1cc414293c5484163a110e56e80af7edeafa2dbc82f4c4cc3268cfb78"} Jul 29 00:08:29.111107 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:29.111059 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:29.111661 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.111216 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:29.111741 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:29.111680 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:29.111815 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.111781 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:29.260752 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:29.260690 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" event={"ID":"2d59c7f673952f894c1943cf0c2fc197","Type":"ContainerStarted","Data":"94c38e57309f37fc10eca022cd2cef5c82bd4968797a27268a68d9a762f4b13f"} Jul 29 00:08:29.538080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:29.537988 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:29.538080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:29.538037 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:29.538080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:29.538071 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:29.538361 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538219 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:29.538361 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538243 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:29.538361 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538257 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:29.538361 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538312 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:33.538297561 +0000 UTC m=+10.057626185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:29.538837 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538750 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:29.538837 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538806 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:33.538789145 +0000 UTC m=+10.058117771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:29.539007 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538866 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:29.539007 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:29.538899 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:33.538888093 +0000 UTC m=+10.058216722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:30.113208 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:30.112691 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:30.113208 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:30.112830 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:31.110522 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:31.110485 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:31.110761 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:31.110667 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:31.111137 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:31.111114 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:31.111255 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:31.111224 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:32.111113 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:32.111027 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:32.111552 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:32.111177 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:33.111672 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:33.111190 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:33.111672 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:33.111190 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:33.111672 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.111338 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:33.111672 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.111407 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:33.577264 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:33.577190 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:33.577264 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:33.577239 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:33.577264 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:33.577258 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:33.577488 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577368 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:33.577488 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577415 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:41.577403387 +0000 UTC m=+18.096732010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:33.577685 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577660 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:33.577821 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577714 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:41.577702643 +0000 UTC m=+18.097031272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:33.577821 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577791 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:33.577821 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577818 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:33.577979 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577832 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:33.577979 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:33.577890 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:41.577872598 +0000 UTC m=+18.097201239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:34.112678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:34.112244 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:34.112678 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:34.112358 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:35.110966 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:35.110931 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:35.111153 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:35.110936 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:35.111153 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:35.111084 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:35.111253 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:35.111147 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:36.110923 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:36.110893 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:36.111370 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:36.111032 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:37.110725 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:37.110686 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:37.110725 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:37.110718 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:37.110966 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:37.110815 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:37.110966 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:37.110900 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:38.111319 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:38.111288 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:38.111694 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:38.111401 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:39.110670 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:39.110634 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:39.110670 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:39.110661 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:39.110872 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:39.110766 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:39.110910 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:39.110877 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:40.110970 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:40.110942 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:40.111419 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:40.111053 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:41.110189 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:41.110157 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:41.110403 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:41.110157 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:41.110403 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.110284 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:41.110403 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.110371 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:41.643957 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:41.643925 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:41.643957 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:41.643963 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:41.644008 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644088 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644112 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644127 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644137 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644158 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:57.644136936 +0000 UTC m=+34.163465562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644097 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644183 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:57.644167621 +0000 UTC m=+34.163496266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:41.644498 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:41.644215 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:57.644203064 +0000 UTC m=+34.163531693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:42.110577 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:42.110488 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:42.110716 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:42.110655 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:43.110747 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:43.110714 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:43.111179 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:43.110721 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:43.111179 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:43.110879 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:43.111179 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:43.110965 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:44.111864 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:44.111831 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:44.112302 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:44.111936 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:45.110635 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:45.110596 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:45.110821 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:45.110607 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:45.110821 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:45.110720 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:45.110923 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:45.110821 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:46.114285 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.112656 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:46.114677 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:46.114311 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:46.304208 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.304022 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xwf54" event={"ID":"a4735ee1-01e3-46ec-a60a-57b585630928","Type":"ContainerStarted","Data":"f67fd00caaec994f8b4ba27e9e78f34332d4fb091fd8b94d540fb026cc79e230"} Jul 29 00:08:46.305926 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.305900 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"cc093645602de28782973d74daecab335d83535793b0b9db7ca67adccea2ab6f"} Jul 29 00:08:46.306034 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.305981 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"b5ed909feba798d8279fa99c0604c7a179cd9710f98114f1e8bf57ef0af201bd"} Jul 29 00:08:46.307372 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.307345 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xqbv9" event={"ID":"d46c1aa8-c028-4f3c-b959-153572e690f8","Type":"ContainerStarted","Data":"6d0c207ec17187811504afea1ab393a9eda642f35efd304a56a4be1721636708"} Jul 29 00:08:46.308737 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.308711 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnlvt" event={"ID":"00f2508a-589e-4107-9fb1-d787a989bf56","Type":"ContainerStarted","Data":"92a84f567a88c821f4d5ade54fa9bbe6fdce931932449344aa84afba6f85f873"} Jul 29 00:08:46.310298 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.310274 2550 generic.go:356] "Generic (PLEG): container finished" podID="dd40ef28-aae4-4d1b-81e4-9124cc883ba5" containerID="d2c51199a7099dfae8ff46c035455bea7cab8ab2926a00a04ca14a086b096adf" exitCode=0 Jul 29 00:08:46.310384 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.310350 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerDied","Data":"d2c51199a7099dfae8ff46c035455bea7cab8ab2926a00a04ca14a086b096adf"} Jul 29 00:08:46.311913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.311896 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" event={"ID":"dcb5bf61-144c-4e23-8208-33f50c1e26bb","Type":"ContainerStarted","Data":"1422c924a9bf8374beebad4ade7808f53e32a6d977f2296432f451e15b46fab4"} Jul 29 00:08:46.313586 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.313564 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" event={"ID":"ab9b5376-e06d-4bc9-b979-08306a275cc1","Type":"ContainerStarted","Data":"497b3fa44f7508535e58f58e868dfb35eb86a6a059b589b4278c23bcdb66506b"} Jul 29 00:08:46.315032 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.315014 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kgd76" event={"ID":"3805e8fb-5970-4290-9b9f-ed9edbbb33da","Type":"ContainerStarted","Data":"18900f273999121e0c2746c5bf979f61efd42aa8f5913eda1fdad6d24a5acfba"} Jul 29 00:08:46.324760 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.324724 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-130.ec2.internal" podStartSLOduration=21.324712908 podStartE2EDuration="21.324712908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:29.280602861 +0000 UTC m=+5.799931513" watchObservedRunningTime="2026-07-29 00:08:46.324712908 +0000 UTC m=+22.844041564" Jul 29 00:08:46.325261 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.325232 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xwf54" podStartSLOduration=3.5488835869999997 podStartE2EDuration="22.32522544s" totalImagesPullingTime="18.776341853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:46.324884555 +0000 UTC m=+22.844213201" watchObservedRunningTime="2026-07-29 00:08:46.32522544 +0000 UTC m=+22.844554085" Jul 29 00:08:46.347105 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.347053 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cnlvt" podStartSLOduration=2.652392355 podStartE2EDuration="21.34703206s" totalImagesPullingTime="18.694639705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:46.346127211 +0000 UTC m=+22.865455857" watchObservedRunningTime="2026-07-29 00:08:46.34703206 +0000 UTC m=+22.866360708" Jul 29 00:08:46.384065 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.384027 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kgd76" podStartSLOduration=3.682331615 podStartE2EDuration="22.384013061s" totalImagesPullingTime="18.701681446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:46.383814886 +0000 UTC m=+22.903143532" watchObservedRunningTime="2026-07-29 00:08:46.384013061 +0000 UTC m=+22.903341707" Jul 29 00:08:46.397262 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.397099 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xqbv9" podStartSLOduration=3.677911248 podStartE2EDuration="22.397081169s" totalImagesPullingTime="18.719169921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:46.396932921 +0000 UTC m=+22.916261568" watchObservedRunningTime="2026-07-29 00:08:46.397081169 +0000 UTC m=+22.916409817" Jul 29 00:08:46.413206 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:46.413169 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vxk9d" podStartSLOduration=2.708389246 podStartE2EDuration="21.413156238s" totalImagesPullingTime="18.704766992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:46.412821661 +0000 UTC m=+22.932150331" watchObservedRunningTime="2026-07-29 00:08:46.413156238 +0000 UTC m=+22.932484881" Jul 29 00:08:47.110497 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.110468 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:47.110703 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:47.110623 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:47.110703 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.110684 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:47.110808 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:47.110784 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:47.319427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.319355 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2lvtr" event={"ID":"0ee6572d-bd29-4d16-8065-f5aef82bfe38","Type":"ContainerStarted","Data":"c6c356e6a56072923fec52ab4a21415a79191137d0a3a156e7a717cd5dc5b4e8"} Jul 29 00:08:47.322998 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.322972 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"d0312b4762c1f52bb1e9c5bf2ec0867c82d13b3761b0979c451b957c9997c301"} Jul 29 00:08:47.323139 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.323051 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"4ca16c60ded4d6097690b42a5cacbe8f1681aaf8ea64baba676f507797599929"} Jul 29 00:08:47.323139 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.323103 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"13e869d1795c79a74696415517af41eac5198a40b3e77b5eb456f302e450da1b"} Jul 29 00:08:47.323245 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.323148 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"e791444caec1485098bec71ed6e1f352c21588398458698feed6fa5e51831e8c"} Jul 29 00:08:47.336646 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.336570 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2lvtr" podStartSLOduration=4.634164407 podStartE2EDuration="23.336542137s" totalImagesPullingTime="18.70237773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:47.336395783 +0000 UTC m=+23.855724430" watchObservedRunningTime="2026-07-29 00:08:47.336542137 +0000 UTC m=+23.855870782" Jul 29 00:08:47.456172 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.456148 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:47.456934 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.456913 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:47.542080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.542057 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 00:08:47.962402 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.962306 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T00:08:47.542075776Z","UUID":"46d9711e-df71-4938-90a5-50f18d4a4432","Handler":null,"Name":"","Endpoint":""} Jul 29 00:08:47.963789 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.963768 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 00:08:47.963905 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:47.963804 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 00:08:48.111586 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:48.111220 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:48.111586 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:48.111361 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:48.327910 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:48.327826 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" event={"ID":"ab9b5376-e06d-4bc9-b979-08306a275cc1","Type":"ContainerStarted","Data":"d97ea9fae6777e5be875c276fcd5924086e59835ce539e8fd7557866ec3e3005"} Jul 29 00:08:48.328358 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:48.328255 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:48.328853 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:48.328773 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kgd76" Jul 29 00:08:49.110862 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:49.110827 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:49.111022 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:49.110873 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:49.111022 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:49.110949 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:49.111106 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:49.111084 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:49.332621 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:49.332585 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" event={"ID":"ab9b5376-e06d-4bc9-b979-08306a275cc1","Type":"ContainerStarted","Data":"59e2ab14bc0a672708a4d31af4842ac8f28d8689bb13380e79dfc9bd64036b85"} Jul 29 00:08:49.336567 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:49.336519 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"780273d179e62ed3b5f605bd9f19196125f11036907d04f25ca32b428260440a"} Jul 29 00:08:49.351705 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:49.351658 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2m7q" podStartSLOduration=4.158071918 podStartE2EDuration="25.351644943s" totalImagesPullingTime="21.193573025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:49.35158674 +0000 UTC m=+25.870915377" watchObservedRunningTime="2026-07-29 00:08:49.351644943 +0000 UTC m=+25.870973588" Jul 29 00:08:50.111189 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:50.111161 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:50.111361 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:50.111290 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:51.111176 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.111014 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:51.111856 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.111049 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:51.111856 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:51.111344 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:51.111856 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:51.111245 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:51.342965 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.342888 2550 generic.go:356] "Generic (PLEG): container finished" podID="dd40ef28-aae4-4d1b-81e4-9124cc883ba5" containerID="cad0b2a9a9cdeb9b2fd35328aa7956834ec843c11455457d8f8a057d98c668ac" exitCode=0 Jul 29 00:08:51.343128 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.342986 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerDied","Data":"cad0b2a9a9cdeb9b2fd35328aa7956834ec843c11455457d8f8a057d98c668ac"} Jul 29 00:08:51.347015 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.346837 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" event={"ID":"b82678a6-566f-41f2-bf14-c5c653e69136","Type":"ContainerStarted","Data":"da04493f55592bc13b595b6b896993b2a12dc26a6450a6817ac70841d043e041"} Jul 29 00:08:51.347124 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.347051 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:51.347124 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.347083 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:51.364038 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.364020 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:51.400826 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:51.399057 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" podStartSLOduration=8.627755633 podStartE2EDuration="27.399039426s" totalImagesPullingTime="18.771283793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:51.398637518 +0000 UTC m=+27.917966165" watchObservedRunningTime="2026-07-29 00:08:51.399039426 +0000 UTC m=+27.918368073" Jul 29 00:08:52.110587 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:52.110543 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:52.110796 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:52.110657 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:52.349477 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:52.349450 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:52.364011 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:52.363955 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:08:53.110938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:53.110908 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:53.110938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:53.110937 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:53.111149 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:53.111016 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:53.111149 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:53.111140 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:53.353076 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:53.353042 2550 generic.go:356] "Generic (PLEG): container finished" podID="dd40ef28-aae4-4d1b-81e4-9124cc883ba5" containerID="0573f935164cfdf3adcdb94e054d0bc8bf18c6514c20c695bf778a1e9e87c8c1" exitCode=0 Jul 29 00:08:53.353419 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:53.353127 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerDied","Data":"0573f935164cfdf3adcdb94e054d0bc8bf18c6514c20c695bf778a1e9e87c8c1"} Jul 29 00:08:54.113055 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:54.113030 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:54.113224 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:54.113121 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:55.110458 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:55.110427 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:55.110458 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:55.110459 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:55.110900 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:55.110547 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:55.110900 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:55.110659 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:55.360259 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:55.360230 2550 generic.go:356] "Generic (PLEG): container finished" podID="dd40ef28-aae4-4d1b-81e4-9124cc883ba5" containerID="a3f7d78969f5fc50694a41fa94642720249be352c8018a5968d53799eee961b9" exitCode=0 Jul 29 00:08:55.360427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:55.360285 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerDied","Data":"a3f7d78969f5fc50694a41fa94642720249be352c8018a5968d53799eee961b9"} Jul 29 00:08:56.114436 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:56.114403 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:56.114905 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:56.114508 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:57.110334 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:57.110301 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:57.110518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:57.110344 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:57.110518 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.110439 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:57.110667 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.110526 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:08:57.661989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:57.661950 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:57.661998 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:57.662018 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662101 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662104 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662126 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662150 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662164 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pf2bf for pod openshift-network-diagnostics/network-check-target-2xj27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662153 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret podName:eb77e36d-b896-458b-8dab-8bac9eabde23 nodeName:}" failed. No retries permitted until 2026-07-29 00:09:29.662140071 +0000 UTC m=+66.181468694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret") pod "global-pull-secret-syncer-x7qbk" (UID: "eb77e36d-b896-458b-8dab-8bac9eabde23") : object "kube-system"/"original-pull-secret" not registered Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662214 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs podName:04824004-3845-42c8-9515-b6232e590423 nodeName:}" failed. No retries permitted until 2026-07-29 00:09:29.662196548 +0000 UTC m=+66.181525183 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs") pod "network-metrics-daemon-xk2g8" (UID: "04824004-3845-42c8-9515-b6232e590423") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 00:08:57.662341 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:57.662233 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf podName:3e694011-72c8-46de-a357-b82eb2c8b275 nodeName:}" failed. No retries permitted until 2026-07-29 00:09:29.662222124 +0000 UTC m=+66.181550749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2bf" (UniqueName: "kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf") pod "network-check-target-2xj27" (UID: "3e694011-72c8-46de-a357-b82eb2c8b275") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 00:08:58.110940 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:58.110859 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:08:58.111100 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:58.110995 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:08:59.110907 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:59.110873 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:08:59.110907 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:08:59.110908 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:08:59.111376 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:59.111014 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:08:59.111376 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:08:59.111137 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:00.113408 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:00.113384 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:00.113806 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:00.113473 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:00.374751 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:00.374678 2550 generic.go:356] "Generic (PLEG): container finished" podID="dd40ef28-aae4-4d1b-81e4-9124cc883ba5" containerID="48a9669c2def74bb1c35ed23207e086b156f69e1956b3e3831cb5cf6b77ed70b" exitCode=0 Jul 29 00:09:00.374751 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:00.374734 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerDied","Data":"48a9669c2def74bb1c35ed23207e086b156f69e1956b3e3831cb5cf6b77ed70b"} Jul 29 00:09:01.110912 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:01.110871 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:01.111120 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:01.110871 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:01.111120 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:01.110981 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:01.111120 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:01.111073 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:01.380544 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:01.380516 2550 generic.go:356] "Generic (PLEG): container finished" podID="dd40ef28-aae4-4d1b-81e4-9124cc883ba5" containerID="805632603f03e13636a8be926b2962f37c3f41a2436298b00a67b88327933068" exitCode=0 Jul 29 00:09:01.380900 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:01.380592 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerDied","Data":"805632603f03e13636a8be926b2962f37c3f41a2436298b00a67b88327933068"} Jul 29 00:09:02.111048 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:02.111020 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:02.111220 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:02.111119 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:02.385833 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:02.385803 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n556" event={"ID":"dd40ef28-aae4-4d1b-81e4-9124cc883ba5","Type":"ContainerStarted","Data":"45fb7845d3fd155f00ada80399c08e70fec87ff2356ab4e462b9bcb8ab445987"} Jul 29 00:09:02.408686 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:02.408649 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9n556" podStartSLOduration=8.176363058 podStartE2EDuration="37.408634978s" totalImagesPullingTime="29.23227192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:02.408099597 +0000 UTC m=+38.927428244" watchObservedRunningTime="2026-07-29 00:09:02.408634978 +0000 UTC m=+38.927963650" Jul 29 00:09:03.110658 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:03.110618 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:03.110856 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:03.110737 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:03.110856 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:03.110783 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:03.110980 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:03.110871 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:04.113820 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:04.113655 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:04.114152 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:04.113882 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:05.110486 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:05.110461 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:05.110663 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:05.110462 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:05.110663 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:05.110566 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:05.110768 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:05.110660 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:06.110498 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:06.110466 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:06.110862 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:06.110579 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:07.110567 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:07.110532 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:07.110567 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:07.110567 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:07.110959 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:07.110647 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:07.110959 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:07.110758 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:08.110926 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:08.110891 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:08.111295 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:08.111023 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:09.111184 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:09.111146 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:09.111649 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:09.111246 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:09.111649 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:09.111301 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:09.111649 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:09.111389 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:10.116249 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:10.116214 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:10.116717 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:10.116340 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:11.054780 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:11.054408 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x7qbk"] Jul 29 00:09:11.054780 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:11.054517 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:11.054780 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:11.054640 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:11.058686 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:11.057936 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xk2g8"] Jul 29 00:09:11.058686 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:11.058049 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:11.058686 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:11.058162 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:11.058686 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:11.058630 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2xj27"] Jul 29 00:09:11.058983 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:11.058702 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:11.058983 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:11.058786 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:13.110713 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:13.110682 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:13.111324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:13.110723 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:13.111324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:13.110723 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:13.111324 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:13.110780 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x7qbk" podUID="eb77e36d-b896-458b-8dab-8bac9eabde23" Jul 29 00:09:13.111324 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:13.110883 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk2g8" podUID="04824004-3845-42c8-9515-b6232e590423" Jul 29 00:09:13.111324 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:13.110955 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2xj27" podUID="3e694011-72c8-46de-a357-b82eb2c8b275" Jul 29 00:09:14.706181 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.706154 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-130.ec2.internal" event="NodeReady" Jul 29 00:09:14.706538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.706256 2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 00:09:14.756798 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.756719 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tff7x"] Jul 29 00:09:14.776330 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.776306 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8gflr"] Jul 29 00:09:14.776446 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.776418 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.778907 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.778890 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 00:09:14.778907 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.778895 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wvlt2\"" Jul 29 00:09:14.779127 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.779115 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 00:09:14.789625 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.789606 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gflr"] Jul 29 00:09:14.789715 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.789632 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tff7x"] Jul 29 00:09:14.789715 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.789700 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:14.794024 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.793594 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jmk87\"" Jul 29 00:09:14.794024 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.793709 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 00:09:14.794172 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.794150 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 00:09:14.796280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.794227 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 00:09:14.796280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.795874 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39bcddce-b5b9-42f0-af6f-5875a30b38ae-tmp-dir\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.796280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.795936 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39bcddce-b5b9-42f0-af6f-5875a30b38ae-config-volume\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.796280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.795975 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39bcddce-b5b9-42f0-af6f-5875a30b38ae-metrics-tls\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.796280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.796045 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqrpc\" (UniqueName: \"kubernetes.io/projected/39bcddce-b5b9-42f0-af6f-5875a30b38ae-kube-api-access-gqrpc\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.853325 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.853295 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rlz8x"] Jul 29 00:09:14.871885 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.871860 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rlz8x"] Jul 29 00:09:14.871993 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.871958 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.874753 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.874727 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 00:09:14.874876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.874740 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 00:09:14.874876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.874774 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gmgkv\"" Jul 29 00:09:14.874876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.874803 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 00:09:14.874876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.874808 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 00:09:14.896478 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896452 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39bcddce-b5b9-42f0-af6f-5875a30b38ae-metrics-tls\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.896607 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896486 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e8cb31-31f2-487c-8694-26f2d54569f8-data-volume\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.896607 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896514 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37e8cb31-31f2-487c-8694-26f2d54569f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.896607 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896579 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdckr\" (UniqueName: \"kubernetes.io/projected/37e8cb31-31f2-487c-8694-26f2d54569f8-kube-api-access-kdckr\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.896743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896627 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz4kr\" (UniqueName: \"kubernetes.io/projected/07f494f4-1efe-42c5-967e-367df3b9d133-kube-api-access-hz4kr\") pod \"ingress-canary-8gflr\" (UID: \"07f494f4-1efe-42c5-967e-367df3b9d133\") " pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:14.896743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896656 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37e8cb31-31f2-487c-8694-26f2d54569f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.896743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896700 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqrpc\" (UniqueName: \"kubernetes.io/projected/39bcddce-b5b9-42f0-af6f-5875a30b38ae-kube-api-access-gqrpc\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.896856 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896745 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07f494f4-1efe-42c5-967e-367df3b9d133-cert\") pod \"ingress-canary-8gflr\" (UID: \"07f494f4-1efe-42c5-967e-367df3b9d133\") " pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:14.896856 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896764 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39bcddce-b5b9-42f0-af6f-5875a30b38ae-tmp-dir\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.896856 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896784 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37e8cb31-31f2-487c-8694-26f2d54569f8-crio-socket\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.896856 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.896811 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39bcddce-b5b9-42f0-af6f-5875a30b38ae-config-volume\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.897065 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.897044 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39bcddce-b5b9-42f0-af6f-5875a30b38ae-tmp-dir\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.897320 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.897302 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39bcddce-b5b9-42f0-af6f-5875a30b38ae-config-volume\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.900564 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.900426 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39bcddce-b5b9-42f0-af6f-5875a30b38ae-metrics-tls\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.904582 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.904546 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqrpc\" (UniqueName: \"kubernetes.io/projected/39bcddce-b5b9-42f0-af6f-5875a30b38ae-kube-api-access-gqrpc\") pod \"dns-default-tff7x\" (UID: \"39bcddce-b5b9-42f0-af6f-5875a30b38ae\") " pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:14.997625 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997597 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37e8cb31-31f2-487c-8694-26f2d54569f8-crio-socket\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.997755 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997655 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e8cb31-31f2-487c-8694-26f2d54569f8-data-volume\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.997755 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997680 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37e8cb31-31f2-487c-8694-26f2d54569f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.997755 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997702 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdckr\" (UniqueName: \"kubernetes.io/projected/37e8cb31-31f2-487c-8694-26f2d54569f8-kube-api-access-kdckr\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.997755 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997743 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz4kr\" (UniqueName: \"kubernetes.io/projected/07f494f4-1efe-42c5-967e-367df3b9d133-kube-api-access-hz4kr\") pod \"ingress-canary-8gflr\" (UID: \"07f494f4-1efe-42c5-967e-367df3b9d133\") " pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:14.997894 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997753 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37e8cb31-31f2-487c-8694-26f2d54569f8-crio-socket\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.997959 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997938 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37e8cb31-31f2-487c-8694-26f2d54569f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.998012 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997995 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07f494f4-1efe-42c5-967e-367df3b9d133-cert\") pod \"ingress-canary-8gflr\" (UID: \"07f494f4-1efe-42c5-967e-367df3b9d133\") " pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:14.998065 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.997999 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e8cb31-31f2-487c-8694-26f2d54569f8-data-volume\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:14.998302 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:14.998282 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37e8cb31-31f2-487c-8694-26f2d54569f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:15.000046 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.000026 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37e8cb31-31f2-487c-8694-26f2d54569f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:15.000198 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.000181 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07f494f4-1efe-42c5-967e-367df3b9d133-cert\") pod \"ingress-canary-8gflr\" (UID: \"07f494f4-1efe-42c5-967e-367df3b9d133\") " pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:15.005705 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.005683 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz4kr\" (UniqueName: \"kubernetes.io/projected/07f494f4-1efe-42c5-967e-367df3b9d133-kube-api-access-hz4kr\") pod \"ingress-canary-8gflr\" (UID: \"07f494f4-1efe-42c5-967e-367df3b9d133\") " pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:15.005934 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.005913 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdckr\" (UniqueName: \"kubernetes.io/projected/37e8cb31-31f2-487c-8694-26f2d54569f8-kube-api-access-kdckr\") pod \"insights-runtime-extractor-rlz8x\" (UID: \"37e8cb31-31f2-487c-8694-26f2d54569f8\") " pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:15.086250 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.086150 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:15.099485 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.099463 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gflr" Jul 29 00:09:15.110705 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.110684 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:15.110793 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.110772 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:15.110936 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.110916 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:15.113348 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.113299 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 00:09:15.113446 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.113390 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 00:09:15.113446 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.113432 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 00:09:15.113570 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.113493 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 00:09:15.113570 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.113519 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdg8h\"" Jul 29 00:09:15.113722 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.113707 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thdv6\"" Jul 29 00:09:15.180398 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.180365 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rlz8x" Jul 29 00:09:15.303809 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.303785 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tff7x"] Jul 29 00:09:15.306725 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.306701 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gflr"] Jul 29 00:09:15.307936 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:15.307771 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39bcddce_b5b9_42f0_af6f_5875a30b38ae.slice/crio-ec10e2744735e0cc01b97b3c5345096ae13c0f5ce249922c1fa3ab61f4c451c8 WatchSource:0}: Error finding container ec10e2744735e0cc01b97b3c5345096ae13c0f5ce249922c1fa3ab61f4c451c8: Status 404 returned error can't find the container with id ec10e2744735e0cc01b97b3c5345096ae13c0f5ce249922c1fa3ab61f4c451c8 Jul 29 00:09:15.313277 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:15.313253 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f494f4_1efe_42c5_967e_367df3b9d133.slice/crio-887d4b10cdd83b87fa7df28d84ea33de696f2c917b51cc6b529d4ee11445047e WatchSource:0}: Error finding container 887d4b10cdd83b87fa7df28d84ea33de696f2c917b51cc6b529d4ee11445047e: Status 404 returned error can't find the container with id 887d4b10cdd83b87fa7df28d84ea33de696f2c917b51cc6b529d4ee11445047e Jul 29 00:09:15.328791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.328688 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rlz8x"] Jul 29 00:09:15.330927 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:15.330908 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e8cb31_31f2_487c_8694_26f2d54569f8.slice/crio-f0c641db711c414cb3eddf4e12e33754af847f5892c493b35c7ef26eab457c91 WatchSource:0}: Error finding container f0c641db711c414cb3eddf4e12e33754af847f5892c493b35c7ef26eab457c91: Status 404 returned error can't find the container with id f0c641db711c414cb3eddf4e12e33754af847f5892c493b35c7ef26eab457c91 Jul 29 00:09:15.414225 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.414191 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlz8x" event={"ID":"37e8cb31-31f2-487c-8694-26f2d54569f8","Type":"ContainerStarted","Data":"f0c641db711c414cb3eddf4e12e33754af847f5892c493b35c7ef26eab457c91"} Jul 29 00:09:15.415290 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.415272 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gflr" event={"ID":"07f494f4-1efe-42c5-967e-367df3b9d133","Type":"ContainerStarted","Data":"887d4b10cdd83b87fa7df28d84ea33de696f2c917b51cc6b529d4ee11445047e"} Jul 29 00:09:15.416264 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:15.416247 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tff7x" event={"ID":"39bcddce-b5b9-42f0-af6f-5875a30b38ae","Type":"ContainerStarted","Data":"ec10e2744735e0cc01b97b3c5345096ae13c0f5ce249922c1fa3ab61f4c451c8"} Jul 29 00:09:18.428113 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:18.427914 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tff7x" event={"ID":"39bcddce-b5b9-42f0-af6f-5875a30b38ae","Type":"ContainerStarted","Data":"306172366acb20d2f69b9c8dbc5988a825f474c383a3cb8cfc73f2c151657a29"} Jul 29 00:09:18.428913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:18.428138 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tff7x" event={"ID":"39bcddce-b5b9-42f0-af6f-5875a30b38ae","Type":"ContainerStarted","Data":"1a4815757492a0f40a00e0f7765e03e8ed5abe9fee97c4ea83a5bd55e491557f"} Jul 29 00:09:18.428913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:18.428163 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:18.444784 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:18.444688 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tff7x" podStartSLOduration=2.168572909 podStartE2EDuration="4.444667115s" totalImagesPullingTime="2.276094206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:18.444176714 +0000 UTC m=+54.963505388" watchObservedRunningTime="2026-07-29 00:09:18.444667115 +0000 UTC m=+54.963995787" Jul 29 00:09:21.811590 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.811543 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr"] Jul 29 00:09:21.814173 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.814152 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.816735 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.816712 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 00:09:21.817893 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.817867 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 00:09:21.817893 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.817890 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 00:09:21.818053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.817912 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 00:09:21.818053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.817890 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 00:09:21.818053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.818020 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4v6pv\"" Jul 29 00:09:21.824635 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.824614 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr"] Jul 29 00:09:21.843790 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.843305 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws"] Jul 29 00:09:21.848366 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.848340 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2rhf"] Jul 29 00:09:21.849061 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.849043 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.850739 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.850642 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.850925 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.850900 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94xxh\" (UniqueName: \"kubernetes.io/projected/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-kube-api-access-94xxh\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.851036 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.850952 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.851036 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.850978 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.851151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.851052 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.851684 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.851609 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 00:09:21.851941 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.851917 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 00:09:21.852030 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.851981 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6clvg\"" Jul 29 00:09:21.852149 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.852111 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 00:09:21.852873 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.852853 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 00:09:21.853380 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.853359 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 00:09:21.853472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.853399 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 00:09:21.853472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.853448 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4xnhn\"" Jul 29 00:09:21.858174 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.857851 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws"] Jul 29 00:09:21.952309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952275 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.952472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952316 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-sys\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.952472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952351 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94xxh\" (UniqueName: \"kubernetes.io/projected/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-kube-api-access-94xxh\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.952472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952396 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.952472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952424 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.952472 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952449 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-tls\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.952746 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952472 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-metrics-client-ca\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.952746 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952513 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.952746 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952541 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.952746 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952609 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb57dbb9-54d8-426a-a546-38e52a708e4e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.952746 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952643 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952753 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952780 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952799 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-wtmp\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952830 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-textfile\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952853 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnlwk\" (UniqueName: \"kubernetes.io/projected/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-api-access-cnlwk\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952895 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb57dbb9-54d8-426a-a546-38e52a708e4e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952931 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrx6\" (UniqueName: \"kubernetes.io/projected/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-kube-api-access-pjrx6\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.953002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.952956 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-root\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:21.953376 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.953288 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.956441 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.956413 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.956579 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.956480 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:21.960954 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:21.960914 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94xxh\" (UniqueName: \"kubernetes.io/projected/f52359f9-d318-4ead-b1e7-ddd7c8fdcced-kube-api-access-94xxh\") pod \"openshift-state-metrics-b8f49f5c6-qddfr\" (UID: \"f52359f9-d318-4ead-b1e7-ddd7c8fdcced\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:22.053678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053637 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.053678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053684 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb57dbb9-54d8-426a-a546-38e52a708e4e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053710 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053760 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053784 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053806 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-wtmp\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053840 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-textfile\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053864 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnlwk\" (UniqueName: \"kubernetes.io/projected/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-api-access-cnlwk\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053893 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb57dbb9-54d8-426a-a546-38e52a708e4e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.053938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053926 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrx6\" (UniqueName: \"kubernetes.io/projected/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-kube-api-access-pjrx6\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053951 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-root\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.053979 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054000 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-sys\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054026 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb57dbb9-54d8-426a-a546-38e52a708e4e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054043 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-tls\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054069 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-metrics-client-ca\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054186 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054243 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-root\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054386 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-sys\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:22.054458 2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:22.054473 2550 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:22.054527 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-tls podName:09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a nodeName:}" failed. No retries permitted until 2026-07-29 00:09:22.554500029 +0000 UTC m=+59.073828663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-tls") pod "node-exporter-z2rhf" (UID: "09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a") : secret "node-exporter-tls" not found Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:22.054546 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-tls podName:eb57dbb9-54d8-426a-a546-38e52a708e4e nodeName:}" failed. No retries permitted until 2026-07-29 00:09:22.554536898 +0000 UTC m=+59.073865526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-xzgws" (UID: "eb57dbb9-54d8-426a-a546-38e52a708e4e") : secret "kube-state-metrics-tls" not found Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054682 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-metrics-client-ca\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.054743 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054728 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-wtmp\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.055072 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054849 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb57dbb9-54d8-426a-a546-38e52a708e4e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.055072 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.054970 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-textfile\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.055072 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.055067 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.057198 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.057178 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.057318 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.057214 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.062685 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.062618 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrx6\" (UniqueName: \"kubernetes.io/projected/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-kube-api-access-pjrx6\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.063019 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.062995 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnlwk\" (UniqueName: \"kubernetes.io/projected/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-api-access-cnlwk\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.125639 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.125620 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" Jul 29 00:09:22.269811 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.269778 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr"] Jul 29 00:09:22.272128 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:22.272103 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52359f9_d318_4ead_b1e7_ddd7c8fdcced.slice/crio-e3fc10d16759cc767f3e3eac5646b9ffe9e304e97069ce86617881d891682adb WatchSource:0}: Error finding container e3fc10d16759cc767f3e3eac5646b9ffe9e304e97069ce86617881d891682adb: Status 404 returned error can't find the container with id e3fc10d16759cc767f3e3eac5646b9ffe9e304e97069ce86617881d891682adb Jul 29 00:09:22.439925 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.439894 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlz8x" event={"ID":"37e8cb31-31f2-487c-8694-26f2d54569f8","Type":"ContainerStarted","Data":"983b0dd5ccaa8eb6efd861daa9cf315f9ddd7c54694d1cfa582a1257da4ddf89"} Jul 29 00:09:22.441328 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.441302 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gflr" event={"ID":"07f494f4-1efe-42c5-967e-367df3b9d133","Type":"ContainerStarted","Data":"b0e6cca6ab32074a324c63bde84b89ab85bbf50923f8e4ddcea29c01dc3ce588"} Jul 29 00:09:22.443000 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.442982 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" event={"ID":"f52359f9-d318-4ead-b1e7-ddd7c8fdcced","Type":"ContainerStarted","Data":"9e42663d694cbb07f1b002c9ae26aa34dacd0a70f3db44e1c6e9d14704bc5499"} Jul 29 00:09:22.443088 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.443020 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" event={"ID":"f52359f9-d318-4ead-b1e7-ddd7c8fdcced","Type":"ContainerStarted","Data":"d92308fe9a54e9e5ab25f88a003adfa26940d219a3c7b0fea555f13846fad033"} Jul 29 00:09:22.443088 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.443039 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" event={"ID":"f52359f9-d318-4ead-b1e7-ddd7c8fdcced","Type":"ContainerStarted","Data":"e3fc10d16759cc767f3e3eac5646b9ffe9e304e97069ce86617881d891682adb"} Jul 29 00:09:22.456671 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.456632 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8gflr" podStartSLOduration=1.691492113 podStartE2EDuration="8.456618715s" totalImagesPullingTime="6.765126602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:22.455370921 +0000 UTC m=+58.974699566" watchObservedRunningTime="2026-07-29 00:09:22.456618715 +0000 UTC m=+58.975947360" Jul 29 00:09:22.557776 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.557749 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.557906 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.557800 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-tls\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.560128 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.560103 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb57dbb9-54d8-426a-a546-38e52a708e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzgws\" (UID: \"eb57dbb9-54d8-426a-a546-38e52a708e4e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.560326 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.560309 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a-node-exporter-tls\") pod \"node-exporter-z2rhf\" (UID: \"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a\") " pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.762769 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.762736 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" Jul 29 00:09:22.768141 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.768102 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2rhf" Jul 29 00:09:22.780008 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:22.779978 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e1c762_92b8_4c3b_88dc_e4bbe5d37b3a.slice/crio-a7bf2912a51dd19d3a4a190fe238636d6b2aec50e9b9302cb127ccc5e164e36b WatchSource:0}: Error finding container a7bf2912a51dd19d3a4a190fe238636d6b2aec50e9b9302cb127ccc5e164e36b: Status 404 returned error can't find the container with id a7bf2912a51dd19d3a4a190fe238636d6b2aec50e9b9302cb127ccc5e164e36b Jul 29 00:09:22.872588 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.872545 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 00:09:22.877442 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.877421 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.882018 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.881996 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 00:09:22.882399 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.882382 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 00:09:22.882712 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.882696 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 00:09:22.882996 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.882981 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 00:09:22.883310 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.883294 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 00:09:22.883537 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.883438 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 00:09:22.883680 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.883447 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d4gf7\"" Jul 29 00:09:22.887790 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.887766 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 00:09:22.888069 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.888047 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 00:09:22.889011 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.888251 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 00:09:22.894165 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.894142 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 00:09:22.935212 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.935138 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws"] Jul 29 00:09:22.937757 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:22.937726 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb57dbb9_54d8_426a_a546_38e52a708e4e.slice/crio-fe35f1eb00dea884f6f9d33faa41c1346b1764234bcbe9fd6bf8cfa3ed474dc0 WatchSource:0}: Error finding container fe35f1eb00dea884f6f9d33faa41c1346b1764234bcbe9fd6bf8cfa3ed474dc0: Status 404 returned error can't find the container with id fe35f1eb00dea884f6f9d33faa41c1346b1764234bcbe9fd6bf8cfa3ed474dc0 Jul 29 00:09:22.968703 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968678 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968821 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968711 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-config-volume\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968821 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968737 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968821 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968789 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968837 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968875 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968903 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-config-out\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.968989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.968927 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-web-config\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.969187 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.969001 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.969187 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.969083 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.969187 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.969118 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.969187 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.969143 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:22.969187 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:22.969167 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7xd\" (UniqueName: \"kubernetes.io/projected/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-kube-api-access-5t7xd\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070406 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070331 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070406 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070370 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070406 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070404 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070441 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070469 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-config-out\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070491 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-web-config\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070701 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:23.070546 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-trusted-ca-bundle podName:37a99a74-5698-4e8b-a56b-5ec0a621ad6b nodeName:}" failed. No retries permitted until 2026-07-29 00:09:23.570523391 +0000 UTC m=+60.089852043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "37a99a74-5698-4e8b-a56b-5ec0a621ad6b") : configmap references non-existent config key: ca-bundle.crt Jul 29 00:09:23.070701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070598 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.070701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070699 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.071057 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070732 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.071057 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070761 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.071057 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070786 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7xd\" (UniqueName: \"kubernetes.io/projected/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-kube-api-access-5t7xd\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.071057 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070817 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.071057 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.070849 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-config-volume\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.071295 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.071269 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.072059 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.072033 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.074288 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.074262 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-web-config\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.075201 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.075158 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.075392 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.075341 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-config-out\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.075754 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.075733 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-config-volume\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.075847 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.075790 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.077080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.077021 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.077080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.077047 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.077383 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.077353 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.079050 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.079011 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.081993 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.081811 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7xd\" (UniqueName: \"kubernetes.io/projected/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-kube-api-access-5t7xd\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.449160 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.449099 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2rhf" event={"ID":"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a","Type":"ContainerStarted","Data":"a7bf2912a51dd19d3a4a190fe238636d6b2aec50e9b9302cb127ccc5e164e36b"} Jul 29 00:09:23.450835 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.450765 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" event={"ID":"eb57dbb9-54d8-426a-a546-38e52a708e4e","Type":"ContainerStarted","Data":"fe35f1eb00dea884f6f9d33faa41c1346b1764234bcbe9fd6bf8cfa3ed474dc0"} Jul 29 00:09:23.576833 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.575698 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.577160 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.577108 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a99a74-5698-4e8b-a56b-5ec0a621ad6b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a99a74-5698-4e8b-a56b-5ec0a621ad6b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:23.794342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:23.794259 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 00:09:24.368619 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.368591 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxf2t" Jul 29 00:09:24.795823 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.795789 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7966f448d4-ppc4j"] Jul 29 00:09:24.817338 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.817299 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7966f448d4-ppc4j"] Jul 29 00:09:24.817487 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.817421 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.820099 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820063 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 00:09:24.820245 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820169 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 00:09:24.820245 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820190 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 00:09:24.820400 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820378 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 00:09:24.820400 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820398 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-aa8a6cd512sf6\"" Jul 29 00:09:24.820594 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820499 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xqpw9\"" Jul 29 00:09:24.820594 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.820536 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 00:09:24.887954 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.887924 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888117 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.887996 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-tls\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888117 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.888034 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-grpc-tls\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888117 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.888058 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpq5\" (UniqueName: \"kubernetes.io/projected/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-kube-api-access-plpq5\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888117 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.888095 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.888142 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.888201 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.888324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.888268 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-metrics-client-ca\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989546 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989519 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-grpc-tls\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989712 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989566 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpq5\" (UniqueName: \"kubernetes.io/projected/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-kube-api-access-plpq5\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989712 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989591 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989810 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989774 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989863 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989849 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989915 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989902 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-metrics-client-ca\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.989988 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.989968 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.990068 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.990051 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-tls\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.990812 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.990780 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-metrics-client-ca\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.992710 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.992688 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.992913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.992892 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-grpc-tls\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.993328 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.993301 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.993328 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.993319 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.993501 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.993484 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.993608 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.993592 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-secret-thanos-querier-tls\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:24.998911 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:24.998891 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpq5\" (UniqueName: \"kubernetes.io/projected/46ae86b3-90ca-4d39-bad0-21db21b0cc9b-kube-api-access-plpq5\") pod \"thanos-querier-7966f448d4-ppc4j\" (UID: \"46ae86b3-90ca-4d39-bad0-21db21b0cc9b\") " pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:25.129399 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:25.129327 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:26.034242 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.034213 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 00:09:26.218475 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.218447 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-545485468d-gmfqf"] Jul 29 00:09:26.220731 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.220712 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.223292 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.223276 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 00:09:26.223518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.223506 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 00:09:26.223623 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.223576 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 00:09:26.223623 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.223585 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 00:09:26.223623 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.223601 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3k104gagnblj6\"" Jul 29 00:09:26.223782 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.223657 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-svxpq\"" Jul 29 00:09:26.233381 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.233358 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-545485468d-gmfqf"] Jul 29 00:09:26.238330 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:26.238306 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a99a74_5698_4e8b_a56b_5ec0a621ad6b.slice/crio-c681dc65465e1a80aaac67666d9d07bbbbf77ea67965db682ae55042901c9f53 WatchSource:0}: Error finding container c681dc65465e1a80aaac67666d9d07bbbbf77ea67965db682ae55042901c9f53: Status 404 returned error can't find the container with id c681dc65465e1a80aaac67666d9d07bbbbf77ea67965db682ae55042901c9f53 Jul 29 00:09:26.302596 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302564 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f951deed-5cb2-4054-9053-cc8774bcdc98-audit-log\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.302678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302630 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f951deed-5cb2-4054-9053-cc8774bcdc98-metrics-server-audit-profiles\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.302678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302653 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm2p2\" (UniqueName: \"kubernetes.io/projected/f951deed-5cb2-4054-9053-cc8774bcdc98-kube-api-access-dm2p2\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.302678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302671 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f951deed-5cb2-4054-9053-cc8774bcdc98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.302793 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302703 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-client-ca-bundle\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.302793 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302789 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-secret-metrics-server-tls\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.302902 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.302807 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-secret-metrics-server-client-certs\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.380672 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.379698 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7966f448d4-ppc4j"] Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403673 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f951deed-5cb2-4054-9053-cc8774bcdc98-audit-log\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403728 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f951deed-5cb2-4054-9053-cc8774bcdc98-metrics-server-audit-profiles\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403747 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2p2\" (UniqueName: \"kubernetes.io/projected/f951deed-5cb2-4054-9053-cc8774bcdc98-kube-api-access-dm2p2\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403765 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f951deed-5cb2-4054-9053-cc8774bcdc98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403787 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-client-ca-bundle\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403817 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-secret-metrics-server-tls\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.403841 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-secret-metrics-server-client-certs\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.404672 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.404623 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f951deed-5cb2-4054-9053-cc8774bcdc98-audit-log\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.405785 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.405759 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f951deed-5cb2-4054-9053-cc8774bcdc98-metrics-server-audit-profiles\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.406599 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.406535 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f951deed-5cb2-4054-9053-cc8774bcdc98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.406759 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.406692 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-secret-metrics-server-client-certs\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.408876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.408674 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-client-ca-bundle\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.408876 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.408837 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f951deed-5cb2-4054-9053-cc8774bcdc98-secret-metrics-server-tls\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.412637 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.412608 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2p2\" (UniqueName: \"kubernetes.io/projected/f951deed-5cb2-4054-9053-cc8774bcdc98-kube-api-access-dm2p2\") pod \"metrics-server-545485468d-gmfqf\" (UID: \"f951deed-5cb2-4054-9053-cc8774bcdc98\") " pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.468953 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.468814 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlz8x" event={"ID":"37e8cb31-31f2-487c-8694-26f2d54569f8","Type":"ContainerStarted","Data":"81f306e09b11ad815791ffa1c400b881cdf6ca24b2c5e8d9da4ce01de7002944"} Jul 29 00:09:26.470615 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.470474 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"c681dc65465e1a80aaac67666d9d07bbbbf77ea67965db682ae55042901c9f53"} Jul 29 00:09:26.473457 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.473428 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" event={"ID":"f52359f9-d318-4ead-b1e7-ddd7c8fdcced","Type":"ContainerStarted","Data":"72e58f2676c6cd45ef8fb3fead81df544edd631617233679bbae63fea75ad956"} Jul 29 00:09:26.476713 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.476637 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2rhf" event={"ID":"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a","Type":"ContainerStarted","Data":"257940b08051196844725ef6f9efae960e9b9a4042a93c111b1167f72a884ca2"} Jul 29 00:09:26.480245 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.479257 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" event={"ID":"eb57dbb9-54d8-426a-a546-38e52a708e4e","Type":"ContainerStarted","Data":"81f8103b97725f898fe52e540020ed2f8ab17ff6ca66fcebffb8a0e3ab92afa5"} Jul 29 00:09:26.480245 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.479310 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" event={"ID":"eb57dbb9-54d8-426a-a546-38e52a708e4e","Type":"ContainerStarted","Data":"18253a82d6f8861dbb14a7c2f825f12f80ccd8d4cac33a5311546f8cf8fb89d9"} Jul 29 00:09:26.482353 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.482295 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"7e8d3fef878247ce5756e1675defc90d65ae98b3a76f8e240dd9293266a29067"} Jul 29 00:09:26.501812 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.501757 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qddfr" podStartSLOduration=1.669305954 podStartE2EDuration="5.501734661s" totalImagesPullingTime="3.832428707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:26.500353454 +0000 UTC m=+63.019682138" watchObservedRunningTime="2026-07-29 00:09:26.501734661 +0000 UTC m=+63.021063299" Jul 29 00:09:26.531344 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.531322 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:26.607485 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.606799 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms"] Jul 29 00:09:26.611352 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.610775 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:26.614209 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.613870 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fnr2k\"" Jul 29 00:09:26.614209 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.614086 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 00:09:26.621069 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.621045 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms"] Jul 29 00:09:26.694728 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.692518 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-545485468d-gmfqf"] Jul 29 00:09:26.698353 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:26.698327 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf951deed_5cb2_4054_9053_cc8774bcdc98.slice/crio-d7dfadfb84d7f78cd41a65ec07c31e0aac0018ce75c9dc3f422f166912ea138f WatchSource:0}: Error finding container d7dfadfb84d7f78cd41a65ec07c31e0aac0018ce75c9dc3f422f166912ea138f: Status 404 returned error can't find the container with id d7dfadfb84d7f78cd41a65ec07c31e0aac0018ce75c9dc3f422f166912ea138f Jul 29 00:09:26.709376 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.709354 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvhx5\" (UniqueName: \"kubernetes.io/projected/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-kube-api-access-mvhx5\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:26.709465 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.709428 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:26.809941 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.809861 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvhx5\" (UniqueName: \"kubernetes.io/projected/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-kube-api-access-mvhx5\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:26.810062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.809968 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:26.810117 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:26.810095 2550 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 29 00:09:26.810188 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:09:26.810179 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-monitoring-plugin-cert podName:743f6f22-1ce6-40d4-af62-2fdf307d8aa5 nodeName:}" failed. No retries permitted until 2026-07-29 00:09:27.31015606 +0000 UTC m=+63.829484699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-l74ms" (UID: "743f6f22-1ce6-40d4-af62-2fdf307d8aa5") : secret "monitoring-plugin-cert" not found Jul 29 00:09:26.819405 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:26.819376 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvhx5\" (UniqueName: \"kubernetes.io/projected/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-kube-api-access-mvhx5\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:27.049446 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.049409 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59466b94c6-k2cv7"] Jul 29 00:09:27.052192 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.051818 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.055002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.054906 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 00:09:27.055002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.054926 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 00:09:27.055002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.054998 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 00:09:27.055355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.055130 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ldhgw\"" Jul 29 00:09:27.055355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.055208 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 00:09:27.055355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.055215 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 00:09:27.060932 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.060865 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 00:09:27.067654 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.067629 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59466b94c6-k2cv7"] Jul 29 00:09:27.112021 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.111990 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-telemeter-client-tls\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112174 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112033 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-serving-certs-ca-bundle\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112174 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112085 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-secret-telemeter-client\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112174 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112144 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112213 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112252 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-federate-client-tls\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112274 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkjd8\" (UniqueName: \"kubernetes.io/projected/938e55d8-c58f-45e0-9137-46393b2eed95-kube-api-access-lkjd8\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.112342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.112299 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-metrics-client-ca\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213638 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213608 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213672 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213704 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-federate-client-tls\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213726 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkjd8\" (UniqueName: \"kubernetes.io/projected/938e55d8-c58f-45e0-9137-46393b2eed95-kube-api-access-lkjd8\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213749 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-metrics-client-ca\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213776 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-telemeter-client-tls\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.213997 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.213974 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-serving-certs-ca-bundle\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.214056 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.214042 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-secret-telemeter-client\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.214545 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.214515 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-metrics-client-ca\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.214693 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.214676 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-serving-certs-ca-bundle\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.214752 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.214717 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/938e55d8-c58f-45e0-9137-46393b2eed95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.216394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.216371 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-federate-client-tls\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.216509 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.216492 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-secret-telemeter-client\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.216546 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.216519 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.216622 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.216604 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/938e55d8-c58f-45e0-9137-46393b2eed95-telemeter-client-tls\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.222453 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.222433 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkjd8\" (UniqueName: \"kubernetes.io/projected/938e55d8-c58f-45e0-9137-46393b2eed95-kube-api-access-lkjd8\") pod \"telemeter-client-59466b94c6-k2cv7\" (UID: \"938e55d8-c58f-45e0-9137-46393b2eed95\") " pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.315528 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.315454 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:27.318364 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.318336 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/743f6f22-1ce6-40d4-af62-2fdf307d8aa5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l74ms\" (UID: \"743f6f22-1ce6-40d4-af62-2fdf307d8aa5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:27.363437 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.363400 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" Jul 29 00:09:27.488075 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.488042 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" event={"ID":"f951deed-5cb2-4054-9053-cc8774bcdc98","Type":"ContainerStarted","Data":"d7dfadfb84d7f78cd41a65ec07c31e0aac0018ce75c9dc3f422f166912ea138f"} Jul 29 00:09:27.490787 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.490760 2550 generic.go:356] "Generic (PLEG): container finished" podID="09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a" containerID="257940b08051196844725ef6f9efae960e9b9a4042a93c111b1167f72a884ca2" exitCode=0 Jul 29 00:09:27.490931 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.490844 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2rhf" event={"ID":"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a","Type":"ContainerDied","Data":"257940b08051196844725ef6f9efae960e9b9a4042a93c111b1167f72a884ca2"} Jul 29 00:09:27.490931 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.490896 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2rhf" event={"ID":"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a","Type":"ContainerStarted","Data":"f5e5ddd1d97154c64cc707fada1e44c0520606c7f6865097a3e41444e1dec057"} Jul 29 00:09:27.490931 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.490920 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2rhf" event={"ID":"09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a","Type":"ContainerStarted","Data":"76c106d1bdbbc5b5aec8f733101be50dba000dae8ff13cb39dcf0b7004cd9029"} Jul 29 00:09:27.494964 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.494845 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" event={"ID":"eb57dbb9-54d8-426a-a546-38e52a708e4e","Type":"ContainerStarted","Data":"29aae10ea199190dfecd701856e91b87007475d6d51d2f5c149187f68218c188"} Jul 29 00:09:27.514198 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.514136 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2rhf" podStartSLOduration=3.306470377 podStartE2EDuration="6.514114663s" totalImagesPullingTime="3.11406464s" totalInitContainerRuntime="93.579646ms" isStatefulPod=true podCreationTimestamp="2026-07-29 00:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:27.512732307 +0000 UTC m=+64.032060954" watchObservedRunningTime="2026-07-29 00:09:27.514114663 +0000 UTC m=+64.033443311" Jul 29 00:09:27.529953 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.529926 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:27.540523 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.540470 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzgws" podStartSLOduration=3.214578156 podStartE2EDuration="6.54044705s" totalImagesPullingTime="3.325868894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:27.537002617 +0000 UTC m=+64.056331264" watchObservedRunningTime="2026-07-29 00:09:27.54044705 +0000 UTC m=+64.059775696" Jul 29 00:09:27.660922 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.660889 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59466b94c6-k2cv7"] Jul 29 00:09:27.690363 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:27.690160 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms"] Jul 29 00:09:28.036220 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.036185 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 00:09:28.039714 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.039690 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.042240 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.042216 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 00:09:28.042454 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.042388 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-245z6\"" Jul 29 00:09:28.042588 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.042504 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 00:09:28.042774 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.042746 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7vmubebk1tkef\"" Jul 29 00:09:28.042867 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.042804 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 00:09:28.043049 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043034 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043324 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043341 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043355 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043412 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043414 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043463 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 00:09:28.043645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043333 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 00:09:28.044015 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.043943 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 00:09:28.045942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.045924 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 00:09:28.056123 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.056100 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 00:09:28.068459 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.068437 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124755 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124811 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124845 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124905 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124930 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124955 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.124978 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zljxp\" (UniqueName: \"kubernetes.io/projected/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-kube-api-access-zljxp\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125006 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-config\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125034 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125064 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125103 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125126 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125148 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125191 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125241 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.125681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125276 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.126668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125304 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.126668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125329 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.126668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125372 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.126668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.125457 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227104 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227062 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227261 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227116 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227261 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227149 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227261 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227178 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227261 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227231 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227261 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227255 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227277 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227299 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zljxp\" (UniqueName: \"kubernetes.io/projected/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-kube-api-access-zljxp\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227325 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-config\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227351 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227391 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227422 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227445 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227471 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227513 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227593 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227636 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227872 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227673 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227872 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227697 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.227872 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.227734 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.228468 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.228440 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.228907 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.228881 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.229006 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.228983 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.229470 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.229447 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.230354 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.230328 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.230914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.230890 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.233355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.233243 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.233355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.233293 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.233617 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.233573 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.235397 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.235372 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.236348 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.236302 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.236449 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.236426 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.236523 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.236426 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.236722 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.236703 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.236899 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.236878 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.237308 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.237288 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-config\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.237937 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.237864 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.238529 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.238442 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zljxp\" (UniqueName: \"kubernetes.io/projected/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-kube-api-access-zljxp\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.238826 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.238801 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.239914 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.239876 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.351892 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.351749 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:28.432678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.432650 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tff7x" Jul 29 00:09:28.501627 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.501440 2550 generic.go:356] "Generic (PLEG): container finished" podID="37a99a74-5698-4e8b-a56b-5ec0a621ad6b" containerID="efdf516089c8d9d799ffb6c9ca138306ea2f244707f1d6a16b060a1a7c5568fa" exitCode=0 Jul 29 00:09:28.501627 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.501526 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerDied","Data":"efdf516089c8d9d799ffb6c9ca138306ea2f244707f1d6a16b060a1a7c5568fa"} Jul 29 00:09:28.503910 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.503884 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" event={"ID":"743f6f22-1ce6-40d4-af62-2fdf307d8aa5","Type":"ContainerStarted","Data":"b8c6baa2e4034f389c8d84182f6774e03e029d0f5d081e5590ddd8142fd58e61"} Jul 29 00:09:28.506234 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:28.506211 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" event={"ID":"938e55d8-c58f-45e0-9137-46393b2eed95","Type":"ContainerStarted","Data":"362e5023c99c55505aecb38a3129ef328346a7d9bf2da88a63bc2c3593f1f2c1"} Jul 29 00:09:29.746503 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.746466 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:29.746919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.746521 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:29.746919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.746592 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:29.749783 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.749587 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 00:09:29.751189 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.750784 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 00:09:29.751189 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.751006 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 00:09:29.759492 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.759471 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 00:09:29.760343 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.760317 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04824004-3845-42c8-9515-b6232e590423-metrics-certs\") pod \"network-metrics-daemon-xk2g8\" (UID: \"04824004-3845-42c8-9515-b6232e590423\") " pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:29.761067 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.761038 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb77e36d-b896-458b-8dab-8bac9eabde23-original-pull-secret\") pod \"global-pull-secret-syncer-x7qbk\" (UID: \"eb77e36d-b896-458b-8dab-8bac9eabde23\") " pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:29.770467 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.770443 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2bf\" (UniqueName: \"kubernetes.io/projected/3e694011-72c8-46de-a357-b82eb2c8b275-kube-api-access-pf2bf\") pod \"network-check-target-2xj27\" (UID: \"3e694011-72c8-46de-a357-b82eb2c8b275\") " pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:29.824044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.824012 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdg8h\"" Jul 29 00:09:29.829197 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.829173 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x7qbk" Jul 29 00:09:29.831702 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.831674 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:29.835030 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.834955 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thdv6\"" Jul 29 00:09:29.842811 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:29.842779 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk2g8" Jul 29 00:09:31.309361 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:31.309329 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 00:09:31.524600 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:31.524562 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ff0ad1_d2a3_41e3_80e8_f6244ecd10c2.slice/crio-adab5900525fbed32af248084a00478ebaebc3ec04fec83611d66c73edfa3eb8 WatchSource:0}: Error finding container adab5900525fbed32af248084a00478ebaebc3ec04fec83611d66c73edfa3eb8: Status 404 returned error can't find the container with id adab5900525fbed32af248084a00478ebaebc3ec04fec83611d66c73edfa3eb8 Jul 29 00:09:31.645565 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:31.645520 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x7qbk"] Jul 29 00:09:32.361134 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:32.361094 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb77e36d_b896_458b_8dab_8bac9eabde23.slice/crio-23e1f9dff75d27c8a7cfc103034b2d2d560b105f60297487b054313037339ae4 WatchSource:0}: Error finding container 23e1f9dff75d27c8a7cfc103034b2d2d560b105f60297487b054313037339ae4: Status 404 returned error can't find the container with id 23e1f9dff75d27c8a7cfc103034b2d2d560b105f60297487b054313037339ae4 Jul 29 00:09:32.521174 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:32.521138 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x7qbk" event={"ID":"eb77e36d-b896-458b-8dab-8bac9eabde23","Type":"ContainerStarted","Data":"23e1f9dff75d27c8a7cfc103034b2d2d560b105f60297487b054313037339ae4"} Jul 29 00:09:32.522220 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:32.522200 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"adab5900525fbed32af248084a00478ebaebc3ec04fec83611d66c73edfa3eb8"} Jul 29 00:09:32.798143 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:32.797829 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2xj27"] Jul 29 00:09:32.806482 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:32.806444 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e694011_72c8_46de_a357_b82eb2c8b275.slice/crio-ec6c1722e1ab6122b43610325ec44bd8a0fc158898bc210f959be45ffb4fac4b WatchSource:0}: Error finding container ec6c1722e1ab6122b43610325ec44bd8a0fc158898bc210f959be45ffb4fac4b: Status 404 returned error can't find the container with id ec6c1722e1ab6122b43610325ec44bd8a0fc158898bc210f959be45ffb4fac4b Jul 29 00:09:32.822832 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:32.822236 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xk2g8"] Jul 29 00:09:32.828799 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:09:32.828775 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04824004_3845_42c8_9515_b6232e590423.slice/crio-712b5caa63462f49ecf758c66704eaf1fba89a0250b53149cd37a0cacaed8131 WatchSource:0}: Error finding container 712b5caa63462f49ecf758c66704eaf1fba89a0250b53149cd37a0cacaed8131: Status 404 returned error can't find the container with id 712b5caa63462f49ecf758c66704eaf1fba89a0250b53149cd37a0cacaed8131 Jul 29 00:09:33.530135 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.530094 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"0baeecfd1d0e5ab61c546addc08248f09927a06edeef48d81b77ea02b44329b5"} Jul 29 00:09:33.530601 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.530211 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"e545f16de0e68a3d64bd9aaac902bcca86d6ba2b69df8724c02eb839722961bc"} Jul 29 00:09:33.530601 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.530265 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"9e7b063d5c820d82954b909dbf4d78ebc239dadab334261eb1d8a02ce9896c42"} Jul 29 00:09:33.531851 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.531823 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" event={"ID":"f951deed-5cb2-4054-9053-cc8774bcdc98","Type":"ContainerStarted","Data":"1df7a57fd714492da7052bd00f4a07366781e0164fd79b1275524d9b0d798a8d"} Jul 29 00:09:33.533327 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.533297 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2xj27" event={"ID":"3e694011-72c8-46de-a357-b82eb2c8b275","Type":"ContainerStarted","Data":"ec6c1722e1ab6122b43610325ec44bd8a0fc158898bc210f959be45ffb4fac4b"} Jul 29 00:09:33.535765 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.535733 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlz8x" event={"ID":"37e8cb31-31f2-487c-8694-26f2d54569f8","Type":"ContainerStarted","Data":"4680e1b0e78b92cc4507bcaaaf28686ba4de477051780839b451b69759b592e5"} Jul 29 00:09:33.539095 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.539072 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"4645256eef07b6520861bf73eac80c77fa1457ccc3d157b5bd52146c77c9972d"} Jul 29 00:09:33.539199 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.539138 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"c60869e523274a3aa1e772ed7c3cb5dd110bca1bb7fd7f35bdf32aaa1b341569"} Jul 29 00:09:33.539199 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.539178 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"f8628cd1348766c32b3ebc57c61dba1f4536cf408db1ca8a99a3997c4cb18f31"} Jul 29 00:09:33.539295 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.539220 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"a1922d24f45034171af31d3c5f4d4c55e8224f20c9b1d0fed825398730f3406a"} Jul 29 00:09:33.539295 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.539258 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"703b7ac74480167a1f405599a6eb96aed3a4265c0d0c854e7adf832ba8ad1135"} Jul 29 00:09:33.540792 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.540765 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" event={"ID":"743f6f22-1ce6-40d4-af62-2fdf307d8aa5","Type":"ContainerStarted","Data":"d04993037fc41f75b6a2559c0705c5024e4a6defbd51514a8eaca05858ca1bc2"} Jul 29 00:09:33.540999 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.540923 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:33.544316 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.544236 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" event={"ID":"938e55d8-c58f-45e0-9137-46393b2eed95","Type":"ContainerStarted","Data":"f54acf1e24075b2c6a0aa02558b83e2355629dafde229a60d625c3fba722ae16"} Jul 29 00:09:33.544316 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.544288 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" event={"ID":"938e55d8-c58f-45e0-9137-46393b2eed95","Type":"ContainerStarted","Data":"cfc78f68922252401f8622426574f8a3f0a53c573ddeabed165a539204af6b56"} Jul 29 00:09:33.544467 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.544317 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" event={"ID":"938e55d8-c58f-45e0-9137-46393b2eed95","Type":"ContainerStarted","Data":"03389581307bf68f9b5cbfedc46ca607b6304475f066b0bef4c54d64f4364ce6"} Jul 29 00:09:33.546960 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.546935 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2" containerID="31ed7c498ddcc702659679d5bab5c4e8fa859ca25f536881d2d27b76d547630f" exitCode=0 Jul 29 00:09:33.547142 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.547119 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerDied","Data":"31ed7c498ddcc702659679d5bab5c4e8fa859ca25f536881d2d27b76d547630f"} Jul 29 00:09:33.547242 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.547227 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" Jul 29 00:09:33.550218 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.549847 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" podStartSLOduration=2.39126661 podStartE2EDuration="7.549829507s" totalImagesPullingTime="5.158562897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:33.547809609 +0000 UTC m=+70.067138273" watchObservedRunningTime="2026-07-29 00:09:33.549829507 +0000 UTC m=+70.069158133" Jul 29 00:09:33.550860 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.550792 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xk2g8" event={"ID":"04824004-3845-42c8-9515-b6232e590423","Type":"ContainerStarted","Data":"712b5caa63462f49ecf758c66704eaf1fba89a0250b53149cd37a0cacaed8131"} Jul 29 00:09:33.566463 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.566128 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rlz8x" podStartSLOduration=2.437306043 podStartE2EDuration="19.566110631s" totalImagesPullingTime="17.128804588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:09:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:33.565633453 +0000 UTC m=+70.084962305" watchObservedRunningTime="2026-07-29 00:09:33.566110631 +0000 UTC m=+70.085439278" Jul 29 00:09:33.586424 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.586374 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59466b94c6-k2cv7" podStartSLOduration=1.6364253770000001 podStartE2EDuration="6.586356174s" totalImagesPullingTime="4.949930797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:33.585712184 +0000 UTC m=+70.105040857" watchObservedRunningTime="2026-07-29 00:09:33.586356174 +0000 UTC m=+70.105684820" Jul 29 00:09:33.605850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:33.605802 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l74ms" podStartSLOduration=2.663767487 podStartE2EDuration="7.605786429s" totalImagesPullingTime="4.942018942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:33.604412079 +0000 UTC m=+70.123740747" watchObservedRunningTime="2026-07-29 00:09:33.605786429 +0000 UTC m=+70.125115080" Jul 29 00:09:34.561197 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.561164 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xk2g8" event={"ID":"04824004-3845-42c8-9515-b6232e590423","Type":"ContainerStarted","Data":"2884b00c1bdc70b4eaca24594cf991917f6a3faeb8b00214f3356625ec45884f"} Jul 29 00:09:34.561649 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.561256 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xk2g8" event={"ID":"04824004-3845-42c8-9515-b6232e590423","Type":"ContainerStarted","Data":"34b269af8a2b67dab0d98740967bd76a55127a0a604c98326747a1e4c9bac9cb"} Jul 29 00:09:34.567067 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.566906 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"f03cc102dc3b2d229af7ddf3d76f645cbdf926370ea6661c48c4e54fec8bee1b"} Jul 29 00:09:34.567067 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.566965 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"578cc788558affd13be20ff106d1ec37c7f0c93e9f80f9ee2f28b1495b1adfd2"} Jul 29 00:09:34.567067 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.567007 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" event={"ID":"46ae86b3-90ca-4d39-bad0-21db21b0cc9b","Type":"ContainerStarted","Data":"ec9069833329a25eeaf18588b644109984f73eb8a796989dde20bbe5c32b143f"} Jul 29 00:09:34.567067 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.567066 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:34.573535 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.573450 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a99a74-5698-4e8b-a56b-5ec0a621ad6b","Type":"ContainerStarted","Data":"60ca2f787b951347fc0ee88164edd9fa37266df0ca71a86f922ab2deb3c95829"} Jul 29 00:09:34.578388 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.578340 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xk2g8" podStartSLOduration=68.175451148 podStartE2EDuration="1m9.578321682s" totalImagesPullingTime="1.402870534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:34.577497114 +0000 UTC m=+71.096825785" watchObservedRunningTime="2026-07-29 00:09:34.578321682 +0000 UTC m=+71.097650331" Jul 29 00:09:34.604420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.604362 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.123303216 podStartE2EDuration="12.604338952s" totalImagesPullingTime="6.451597548s" totalInitContainerRuntime="29.438188ms" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:34.603127133 +0000 UTC m=+71.122455780" watchObservedRunningTime="2026-07-29 00:09:34.604338952 +0000 UTC m=+71.123667599" Jul 29 00:09:34.626578 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:34.626426 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" podStartSLOduration=4.579270257 podStartE2EDuration="10.626406431s" totalImagesPullingTime="6.047136174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:34.625373048 +0000 UTC m=+71.144701728" watchObservedRunningTime="2026-07-29 00:09:34.626406431 +0000 UTC m=+71.145735078" Jul 29 00:09:39.607722 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.607693 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2xj27" event={"ID":"3e694011-72c8-46de-a357-b82eb2c8b275","Type":"ContainerStarted","Data":"ec673269d95bc193747807a169835cd7e46ebd0c4f812b72a14fea312184d482"} Jul 29 00:09:39.608076 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.607813 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:09:39.611428 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.611404 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"c6d491527da09618b6eaa32f46249bfeca78827629147d90cc565673ca9e465b"} Jul 29 00:09:39.611524 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.611459 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"82c2a82bb99d8e588d335f9039a4f59e54a8a8731e1375e5dc27a2696817c74c"} Jul 29 00:09:39.611524 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.611484 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"dcf172dca1111d387b03f676b080b25f2898ccfbc3b07bb7fe456630f04631ef"} Jul 29 00:09:39.611524 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.611509 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"d19f5e546c9281f2c1f2cd64d1bf111aa494253c78ee8cc3f74383f41efbeaa8"} Jul 29 00:09:39.611720 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.611532 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"51fdf8437f4d3125f3320ff6e473ff3eceeebb3b13729e7440d3a1dc04561c5d"} Jul 29 00:09:39.613438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.613416 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x7qbk" event={"ID":"eb77e36d-b896-458b-8dab-8bac9eabde23","Type":"ContainerStarted","Data":"eb6666e24c21f06e61855a8b4978b48def26d515955f8cfa9a2105173b2f1f5d"} Jul 29 00:09:39.625122 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.625077 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2xj27" podStartSLOduration=69.26118053 podStartE2EDuration="1m15.625062576s" totalImagesPullingTime="6.363882046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:39.623927119 +0000 UTC m=+76.143255785" watchObservedRunningTime="2026-07-29 00:09:39.625062576 +0000 UTC m=+76.144391221" Jul 29 00:09:39.639339 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:39.639298 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x7qbk" podStartSLOduration=68.068126585 podStartE2EDuration="1m14.639283546s" totalImagesPullingTime="6.571156961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:39.637761326 +0000 UTC m=+76.157089994" watchObservedRunningTime="2026-07-29 00:09:39.639283546 +0000 UTC m=+76.158612192" Jul 29 00:09:40.585858 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:40.585831 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7966f448d4-ppc4j" Jul 29 00:09:40.624394 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:40.624365 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2","Type":"ContainerStarted","Data":"2e45fcb714ac1b91cf35d9b5a9e150a4f71bdfdf3feb48883af8a6613c9cbca9"} Jul 29 00:09:40.655969 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:40.655917 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.003929402 podStartE2EDuration="12.655901225s" totalImagesPullingTime="5.633838401s" totalInitContainerRuntime="18.133422ms" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:40.654434083 +0000 UTC m=+77.173762730" watchObservedRunningTime="2026-07-29 00:09:40.655901225 +0000 UTC m=+77.175229871" Jul 29 00:09:43.352305 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:43.352270 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:09:46.532427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:46.532315 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:09:46.532427 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:09:46.532371 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:10:06.537324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:10:06.537294 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:10:06.541175 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:10:06.541151 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-545485468d-gmfqf" Jul 29 00:10:10.626995 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:10:10.626965 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2xj27" Jul 29 00:10:28.352037 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:10:28.352007 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:10:28.371809 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:10:28.371782 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:10:28.826965 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:10:28.826940 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 00:11:40.802125 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.802091 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59"] Jul 29 00:11:40.804904 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.804889 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.808151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.808127 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 00:11:40.808290 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.808170 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bmw5v\"" Jul 29 00:11:40.809340 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.809325 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 00:11:40.819221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.819196 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59"] Jul 29 00:11:40.829954 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.829926 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.830045 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.829976 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxlh\" (UniqueName: \"kubernetes.io/projected/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-kube-api-access-2qxlh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.830045 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.830006 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.930900 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.930865 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.931111 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.930940 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.931111 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.930979 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxlh\" (UniqueName: \"kubernetes.io/projected/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-kube-api-access-2qxlh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.931386 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.931361 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.931386 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.931375 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:40.939038 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:40.939015 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxlh\" (UniqueName: \"kubernetes.io/projected/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-kube-api-access-2qxlh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:41.114337 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:41.114249 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:11:41.244109 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:41.244084 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59"] Jul 29 00:11:41.245941 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:11:41.245915 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08162f9f_dda7_4ba0_95fb_b9afa31d4b82.slice/crio-3e30f195b1d43290fa0c3f3380176c84dc3af12114c4987a6e1fb9cc1124f6c4 WatchSource:0}: Error finding container 3e30f195b1d43290fa0c3f3380176c84dc3af12114c4987a6e1fb9cc1124f6c4: Status 404 returned error can't find the container with id 3e30f195b1d43290fa0c3f3380176c84dc3af12114c4987a6e1fb9cc1124f6c4 Jul 29 00:11:42.091938 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:42.091905 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" event={"ID":"08162f9f-dda7-4ba0-95fb-b9afa31d4b82","Type":"ContainerStarted","Data":"3e30f195b1d43290fa0c3f3380176c84dc3af12114c4987a6e1fb9cc1124f6c4"} Jul 29 00:11:49.129288 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:49.129250 2550 generic.go:356] "Generic (PLEG): container finished" podID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerID="700313e7de6b59bdfdf12a0808f7a852c05933ded1efc912d91345322b32db6d" exitCode=0 Jul 29 00:11:49.129739 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:49.129308 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" event={"ID":"08162f9f-dda7-4ba0-95fb-b9afa31d4b82","Type":"ContainerDied","Data":"700313e7de6b59bdfdf12a0808f7a852c05933ded1efc912d91345322b32db6d"} Jul 29 00:11:52.143314 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:52.143274 2550 generic.go:356] "Generic (PLEG): container finished" podID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerID="8538c25e9d337196f667e6918b53f1cdb3cac6f14a109c3e7bf550ad552486d8" exitCode=0 Jul 29 00:11:52.143701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:11:52.143358 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" event={"ID":"08162f9f-dda7-4ba0-95fb-b9afa31d4b82","Type":"ContainerDied","Data":"8538c25e9d337196f667e6918b53f1cdb3cac6f14a109c3e7bf550ad552486d8"} Jul 29 00:12:00.178047 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:00.178017 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" event={"ID":"08162f9f-dda7-4ba0-95fb-b9afa31d4b82","Type":"ContainerStarted","Data":"4335cf9c25506ebfd9222dfa1258e8710114f0c63b5e0ef87cbbacfc0017a791"} Jul 29 00:12:00.198073 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:00.198027 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" podStartSLOduration=3.055299504 podStartE2EDuration="20.198011126s" totalImagesPullingTime="17.142711622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:11:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:00.197594114 +0000 UTC m=+216.716922783" watchObservedRunningTime="2026-07-29 00:12:00.198011126 +0000 UTC m=+216.717339773" Jul 29 00:12:01.183375 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:01.183344 2550 generic.go:356] "Generic (PLEG): container finished" podID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerID="4335cf9c25506ebfd9222dfa1258e8710114f0c63b5e0ef87cbbacfc0017a791" exitCode=0 Jul 29 00:12:01.183770 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:01.183420 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" event={"ID":"08162f9f-dda7-4ba0-95fb-b9afa31d4b82","Type":"ContainerDied","Data":"4335cf9c25506ebfd9222dfa1258e8710114f0c63b5e0ef87cbbacfc0017a791"} Jul 29 00:12:02.322181 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.322149 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:12:02.415757 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.415726 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-util\") pod \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " Jul 29 00:12:02.415927 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.415765 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxlh\" (UniqueName: \"kubernetes.io/projected/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-kube-api-access-2qxlh\") pod \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " Jul 29 00:12:02.415927 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.415825 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-bundle\") pod \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\" (UID: \"08162f9f-dda7-4ba0-95fb-b9afa31d4b82\") " Jul 29 00:12:02.416668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.416638 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-bundle" (OuterVolumeSpecName: "bundle") pod "08162f9f-dda7-4ba0-95fb-b9afa31d4b82" (UID: "08162f9f-dda7-4ba0-95fb-b9afa31d4b82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:12:02.417874 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.417851 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-kube-api-access-2qxlh" (OuterVolumeSpecName: "kube-api-access-2qxlh") pod "08162f9f-dda7-4ba0-95fb-b9afa31d4b82" (UID: "08162f9f-dda7-4ba0-95fb-b9afa31d4b82"). InnerVolumeSpecName "kube-api-access-2qxlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:12:02.421935 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.421910 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-util" (OuterVolumeSpecName: "util") pod "08162f9f-dda7-4ba0-95fb-b9afa31d4b82" (UID: "08162f9f-dda7-4ba0-95fb-b9afa31d4b82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:12:02.516546 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.516487 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:02.516546 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.516511 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:02.516546 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:02.516521 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxlh\" (UniqueName: \"kubernetes.io/projected/08162f9f-dda7-4ba0-95fb-b9afa31d4b82-kube-api-access-2qxlh\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:03.192564 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:03.192531 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" Jul 29 00:12:03.192727 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:03.192562 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xt59" event={"ID":"08162f9f-dda7-4ba0-95fb-b9afa31d4b82","Type":"ContainerDied","Data":"3e30f195b1d43290fa0c3f3380176c84dc3af12114c4987a6e1fb9cc1124f6c4"} Jul 29 00:12:03.192727 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:03.192608 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e30f195b1d43290fa0c3f3380176c84dc3af12114c4987a6e1fb9cc1124f6c4" Jul 29 00:12:08.858979 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.858949 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw"] Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859249 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="util" Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859269 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="util" Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859277 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="pull" Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859283 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="pull" Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859299 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="extract" Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859305 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="extract" Jul 29 00:12:08.859418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.859361 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="08162f9f-dda7-4ba0-95fb-b9afa31d4b82" containerName="extract" Jul 29 00:12:08.863506 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.863487 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:08.866438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.866419 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 29 00:12:08.866438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.866431 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 29 00:12:08.866651 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.866431 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-z8jwz\"" Jul 29 00:12:08.892698 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.892677 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw"] Jul 29 00:12:08.970999 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.970971 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whwl\" (UniqueName: \"kubernetes.io/projected/1783b089-7846-4a23-91f0-4afec0c30ac4-kube-api-access-5whwl\") pod \"cert-manager-operator-controller-manager-55c444bf86-264fw\" (UID: \"1783b089-7846-4a23-91f0-4afec0c30ac4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:08.971123 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:08.971022 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1783b089-7846-4a23-91f0-4afec0c30ac4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-264fw\" (UID: \"1783b089-7846-4a23-91f0-4afec0c30ac4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:09.071630 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:09.071602 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whwl\" (UniqueName: \"kubernetes.io/projected/1783b089-7846-4a23-91f0-4afec0c30ac4-kube-api-access-5whwl\") pod \"cert-manager-operator-controller-manager-55c444bf86-264fw\" (UID: \"1783b089-7846-4a23-91f0-4afec0c30ac4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:09.071748 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:09.071649 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1783b089-7846-4a23-91f0-4afec0c30ac4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-264fw\" (UID: \"1783b089-7846-4a23-91f0-4afec0c30ac4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:09.071951 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:09.071937 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1783b089-7846-4a23-91f0-4afec0c30ac4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-264fw\" (UID: \"1783b089-7846-4a23-91f0-4afec0c30ac4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:09.090150 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:09.090122 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whwl\" (UniqueName: \"kubernetes.io/projected/1783b089-7846-4a23-91f0-4afec0c30ac4-kube-api-access-5whwl\") pod \"cert-manager-operator-controller-manager-55c444bf86-264fw\" (UID: \"1783b089-7846-4a23-91f0-4afec0c30ac4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:09.172400 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:09.172370 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" Jul 29 00:12:09.307451 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:09.307424 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw"] Jul 29 00:12:09.309130 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:12:09.309106 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1783b089_7846_4a23_91f0_4afec0c30ac4.slice/crio-a0a2fd27d46e6e527ba8b6d066c1d23d0f95a1f694e39201cc8a8be76c72e5c4 WatchSource:0}: Error finding container a0a2fd27d46e6e527ba8b6d066c1d23d0f95a1f694e39201cc8a8be76c72e5c4: Status 404 returned error can't find the container with id a0a2fd27d46e6e527ba8b6d066c1d23d0f95a1f694e39201cc8a8be76c72e5c4 Jul 29 00:12:10.223182 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:10.223149 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" event={"ID":"1783b089-7846-4a23-91f0-4afec0c30ac4","Type":"ContainerStarted","Data":"a0a2fd27d46e6e527ba8b6d066c1d23d0f95a1f694e39201cc8a8be76c72e5c4"} Jul 29 00:12:11.230566 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:11.230522 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" event={"ID":"1783b089-7846-4a23-91f0-4afec0c30ac4","Type":"ContainerStarted","Data":"b243d2e46d7fd90ce86408dad61d34a27edac7b5202d79430c0646f485f9b234"} Jul 29 00:12:11.257318 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:11.257273 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-264fw" podStartSLOduration=1.459005095 podStartE2EDuration="3.257258865s" totalImagesPullingTime="1.79825377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:11.255986316 +0000 UTC m=+227.775314955" watchObservedRunningTime="2026-07-29 00:12:11.257258865 +0000 UTC m=+227.776587511" Jul 29 00:12:12.388733 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.388692 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-75jt4"] Jul 29 00:12:12.391223 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.391208 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.393975 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.393950 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 00:12:12.394078 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.394009 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 00:12:12.400348 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.400327 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-75jt4"] Jul 29 00:12:12.501191 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.501148 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psj7n\" (UniqueName: \"kubernetes.io/projected/351a5276-23c8-457b-b5d0-eb4c446f8ce1-kube-api-access-psj7n\") pod \"cert-manager-webhook-6486ffd997-75jt4\" (UID: \"351a5276-23c8-457b-b5d0-eb4c446f8ce1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.501191 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.501205 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351a5276-23c8-457b-b5d0-eb4c446f8ce1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-75jt4\" (UID: \"351a5276-23c8-457b-b5d0-eb4c446f8ce1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.602136 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.602107 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psj7n\" (UniqueName: \"kubernetes.io/projected/351a5276-23c8-457b-b5d0-eb4c446f8ce1-kube-api-access-psj7n\") pod \"cert-manager-webhook-6486ffd997-75jt4\" (UID: \"351a5276-23c8-457b-b5d0-eb4c446f8ce1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.602301 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.602142 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351a5276-23c8-457b-b5d0-eb4c446f8ce1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-75jt4\" (UID: \"351a5276-23c8-457b-b5d0-eb4c446f8ce1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.611051 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.611031 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351a5276-23c8-457b-b5d0-eb4c446f8ce1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-75jt4\" (UID: \"351a5276-23c8-457b-b5d0-eb4c446f8ce1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.611247 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.611224 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psj7n\" (UniqueName: \"kubernetes.io/projected/351a5276-23c8-457b-b5d0-eb4c446f8ce1-kube-api-access-psj7n\") pod \"cert-manager-webhook-6486ffd997-75jt4\" (UID: \"351a5276-23c8-457b-b5d0-eb4c446f8ce1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.621239 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.621214 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h"] Jul 29 00:12:12.624334 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.624320 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.626947 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.626931 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 00:12:12.627062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.626947 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bmw5v\"" Jul 29 00:12:12.627299 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.627284 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 00:12:12.633804 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.633773 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h"] Jul 29 00:12:12.702888 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.702820 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bn6x\" (UniqueName: \"kubernetes.io/projected/9ab729af-4782-4707-928f-c8fce44b8937-kube-api-access-9bn6x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.702888 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.702876 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.703057 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.702947 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.712701 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.712683 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:12.804297 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.804270 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bn6x\" (UniqueName: \"kubernetes.io/projected/9ab729af-4782-4707-928f-c8fce44b8937-kube-api-access-9bn6x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.804426 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.804320 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.804426 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.804353 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.804789 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.804769 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.804853 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.804779 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.819260 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.819233 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bn6x\" (UniqueName: \"kubernetes.io/projected/9ab729af-4782-4707-928f-c8fce44b8937-kube-api-access-9bn6x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:12.840605 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.840584 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-75jt4"] Jul 29 00:12:12.842148 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:12:12.842128 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod351a5276_23c8_457b_b5d0_eb4c446f8ce1.slice/crio-41597aed1975880e8384d76d39fc752eccd17cddb8a7efbd6fc9ae8b70e491f7 WatchSource:0}: Error finding container 41597aed1975880e8384d76d39fc752eccd17cddb8a7efbd6fc9ae8b70e491f7: Status 404 returned error can't find the container with id 41597aed1975880e8384d76d39fc752eccd17cddb8a7efbd6fc9ae8b70e491f7 Jul 29 00:12:12.936748 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:12.936722 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:13.059534 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:13.059512 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h"] Jul 29 00:12:13.061715 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:12:13.061685 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab729af_4782_4707_928f_c8fce44b8937.slice/crio-f7d4bad5cce7f4a08c8ae2f5d34f54e1cda0ce59c087acbc7d2635a818e2b69d WatchSource:0}: Error finding container f7d4bad5cce7f4a08c8ae2f5d34f54e1cda0ce59c087acbc7d2635a818e2b69d: Status 404 returned error can't find the container with id f7d4bad5cce7f4a08c8ae2f5d34f54e1cda0ce59c087acbc7d2635a818e2b69d Jul 29 00:12:13.240672 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:13.240595 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" event={"ID":"351a5276-23c8-457b-b5d0-eb4c446f8ce1","Type":"ContainerStarted","Data":"41597aed1975880e8384d76d39fc752eccd17cddb8a7efbd6fc9ae8b70e491f7"} Jul 29 00:12:13.241936 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:13.241911 2550 generic.go:356] "Generic (PLEG): container finished" podID="9ab729af-4782-4707-928f-c8fce44b8937" containerID="48f2246140e8472384013323bc6c663a0d0a5d856a793403e24a712a38487d31" exitCode=0 Jul 29 00:12:13.242030 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:13.241979 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" event={"ID":"9ab729af-4782-4707-928f-c8fce44b8937","Type":"ContainerDied","Data":"48f2246140e8472384013323bc6c663a0d0a5d856a793403e24a712a38487d31"} Jul 29 00:12:13.242030 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:13.242017 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" event={"ID":"9ab729af-4782-4707-928f-c8fce44b8937","Type":"ContainerStarted","Data":"f7d4bad5cce7f4a08c8ae2f5d34f54e1cda0ce59c087acbc7d2635a818e2b69d"} Jul 29 00:12:17.264567 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:17.264520 2550 generic.go:356] "Generic (PLEG): container finished" podID="9ab729af-4782-4707-928f-c8fce44b8937" containerID="e73bcbc24c9c8b9912162af9eb32c9f276c23033e1b1829ac7177359813a6f9b" exitCode=0 Jul 29 00:12:17.265010 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:17.264588 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" event={"ID":"9ab729af-4782-4707-928f-c8fce44b8937","Type":"ContainerDied","Data":"e73bcbc24c9c8b9912162af9eb32c9f276c23033e1b1829ac7177359813a6f9b"} Jul 29 00:12:17.266186 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:17.266161 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" event={"ID":"351a5276-23c8-457b-b5d0-eb4c446f8ce1","Type":"ContainerStarted","Data":"1b48055d4aa7bffdbaa70357e6ccc9b1a729c582484730090a3ecd1594963a37"} Jul 29 00:12:17.266303 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:17.266248 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:17.311059 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:17.311014 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" podStartSLOduration=1.652598962 podStartE2EDuration="5.310993948s" totalImagesPullingTime="3.658394986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:17.308789544 +0000 UTC m=+233.828118192" watchObservedRunningTime="2026-07-29 00:12:17.310993948 +0000 UTC m=+233.830322593" Jul 29 00:12:18.273208 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:18.273172 2550 generic.go:356] "Generic (PLEG): container finished" podID="9ab729af-4782-4707-928f-c8fce44b8937" containerID="48feaf20c880b524a3435400478fa1b663434274f45ab8cfccbfde29cd566b09" exitCode=0 Jul 29 00:12:18.273638 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:18.273213 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" event={"ID":"9ab729af-4782-4707-928f-c8fce44b8937","Type":"ContainerDied","Data":"48feaf20c880b524a3435400478fa1b663434274f45ab8cfccbfde29cd566b09"} Jul 29 00:12:19.398269 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.398249 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:19.565838 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.565761 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-util\") pod \"9ab729af-4782-4707-928f-c8fce44b8937\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " Jul 29 00:12:19.565990 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.565873 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bn6x\" (UniqueName: \"kubernetes.io/projected/9ab729af-4782-4707-928f-c8fce44b8937-kube-api-access-9bn6x\") pod \"9ab729af-4782-4707-928f-c8fce44b8937\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " Jul 29 00:12:19.565990 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.565897 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-bundle\") pod \"9ab729af-4782-4707-928f-c8fce44b8937\" (UID: \"9ab729af-4782-4707-928f-c8fce44b8937\") " Jul 29 00:12:19.566330 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.566306 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-bundle" (OuterVolumeSpecName: "bundle") pod "9ab729af-4782-4707-928f-c8fce44b8937" (UID: "9ab729af-4782-4707-928f-c8fce44b8937"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:12:19.567975 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.567957 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab729af-4782-4707-928f-c8fce44b8937-kube-api-access-9bn6x" (OuterVolumeSpecName: "kube-api-access-9bn6x") pod "9ab729af-4782-4707-928f-c8fce44b8937" (UID: "9ab729af-4782-4707-928f-c8fce44b8937"). InnerVolumeSpecName "kube-api-access-9bn6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:12:19.570195 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.570164 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-util" (OuterVolumeSpecName: "util") pod "9ab729af-4782-4707-928f-c8fce44b8937" (UID: "9ab729af-4782-4707-928f-c8fce44b8937"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:12:19.666980 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.666951 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bn6x\" (UniqueName: \"kubernetes.io/projected/9ab729af-4782-4707-928f-c8fce44b8937-kube-api-access-9bn6x\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:19.666980 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.666975 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:19.666980 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:19.666986 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab729af-4782-4707-928f-c8fce44b8937-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:20.283989 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:20.283958 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" event={"ID":"9ab729af-4782-4707-928f-c8fce44b8937","Type":"ContainerDied","Data":"f7d4bad5cce7f4a08c8ae2f5d34f54e1cda0ce59c087acbc7d2635a818e2b69d"} Jul 29 00:12:20.284120 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:20.283999 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7sj7h" Jul 29 00:12:20.284120 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:20.284004 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7d4bad5cce7f4a08c8ae2f5d34f54e1cda0ce59c087acbc7d2635a818e2b69d" Jul 29 00:12:23.275281 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:23.275249 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-75jt4" Jul 29 00:12:24.934063 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934033 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h7scv"] Jul 29 00:12:24.934420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934350 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="extract" Jul 29 00:12:24.934420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934362 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="extract" Jul 29 00:12:24.934420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934374 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="util" Jul 29 00:12:24.934420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934379 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="util" Jul 29 00:12:24.934420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934386 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="pull" Jul 29 00:12:24.934420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934391 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="pull" Jul 29 00:12:24.934636 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.934440 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab729af-4782-4707-928f-c8fce44b8937" containerName="extract" Jul 29 00:12:24.936529 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.936514 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:24.938948 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.938926 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qspbb\"" Jul 29 00:12:24.945256 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:24.945234 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h7scv"] Jul 29 00:12:25.011186 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.011155 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6f9h\" (UniqueName: \"kubernetes.io/projected/d1de2dac-24b2-4974-b3bd-6b2036dd1d47-kube-api-access-k6f9h\") pod \"cert-manager-55b4d954d5-h7scv\" (UID: \"d1de2dac-24b2-4974-b3bd-6b2036dd1d47\") " pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.011331 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.011214 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1de2dac-24b2-4974-b3bd-6b2036dd1d47-bound-sa-token\") pod \"cert-manager-55b4d954d5-h7scv\" (UID: \"d1de2dac-24b2-4974-b3bd-6b2036dd1d47\") " pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.111496 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.111471 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1de2dac-24b2-4974-b3bd-6b2036dd1d47-bound-sa-token\") pod \"cert-manager-55b4d954d5-h7scv\" (UID: \"d1de2dac-24b2-4974-b3bd-6b2036dd1d47\") " pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.111651 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.111535 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6f9h\" (UniqueName: \"kubernetes.io/projected/d1de2dac-24b2-4974-b3bd-6b2036dd1d47-kube-api-access-k6f9h\") pod \"cert-manager-55b4d954d5-h7scv\" (UID: \"d1de2dac-24b2-4974-b3bd-6b2036dd1d47\") " pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.120111 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.120085 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1de2dac-24b2-4974-b3bd-6b2036dd1d47-bound-sa-token\") pod \"cert-manager-55b4d954d5-h7scv\" (UID: \"d1de2dac-24b2-4974-b3bd-6b2036dd1d47\") " pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.120215 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.120193 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6f9h\" (UniqueName: \"kubernetes.io/projected/d1de2dac-24b2-4974-b3bd-6b2036dd1d47-kube-api-access-k6f9h\") pod \"cert-manager-55b4d954d5-h7scv\" (UID: \"d1de2dac-24b2-4974-b3bd-6b2036dd1d47\") " pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.245861 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.245788 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h7scv" Jul 29 00:12:25.378465 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:25.378442 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h7scv"] Jul 29 00:12:25.380147 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:12:25.380119 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1de2dac_24b2_4974_b3bd_6b2036dd1d47.slice/crio-b452ac7a0d53b53248cc9ed3ffe5d9d18389a67d795cfcdfac24e078b8efc563 WatchSource:0}: Error finding container b452ac7a0d53b53248cc9ed3ffe5d9d18389a67d795cfcdfac24e078b8efc563: Status 404 returned error can't find the container with id b452ac7a0d53b53248cc9ed3ffe5d9d18389a67d795cfcdfac24e078b8efc563 Jul 29 00:12:26.312971 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:26.312935 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h7scv" event={"ID":"d1de2dac-24b2-4974-b3bd-6b2036dd1d47","Type":"ContainerStarted","Data":"3c7e126aa2080faacb8dda1786eec4ff416b1ec9af39414d622ae281d1ca8805"} Jul 29 00:12:26.313351 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:26.312981 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h7scv" event={"ID":"d1de2dac-24b2-4974-b3bd-6b2036dd1d47","Type":"ContainerStarted","Data":"b452ac7a0d53b53248cc9ed3ffe5d9d18389a67d795cfcdfac24e078b8efc563"} Jul 29 00:12:26.329603 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:26.329545 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-h7scv" podStartSLOduration=2.32953195 podStartE2EDuration="2.32953195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:12:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:26.328523741 +0000 UTC m=+242.847852386" watchObservedRunningTime="2026-07-29 00:12:26.32953195 +0000 UTC m=+242.848860587" Jul 29 00:12:35.452901 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.452870 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9"] Jul 29 00:12:35.458873 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.458853 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.461911 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.461889 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 00:12:35.461911 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.461904 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 00:12:35.462106 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.461911 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bmw5v\"" Jul 29 00:12:35.462946 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.462925 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9"] Jul 29 00:12:35.497227 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.497201 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.497332 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.497248 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4hwr\" (UniqueName: \"kubernetes.io/projected/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-kube-api-access-c4hwr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.497332 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.497297 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.598218 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.598190 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.598329 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.598242 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hwr\" (UniqueName: \"kubernetes.io/projected/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-kube-api-access-c4hwr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.598329 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.598283 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.598542 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.598525 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.598613 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.598573 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.606839 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.606816 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hwr\" (UniqueName: \"kubernetes.io/projected/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-kube-api-access-c4hwr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.770746 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.770678 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:35.902594 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:35.902397 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9"] Jul 29 00:12:35.904743 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:12:35.904717 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91126f0_69f2_4b80_afbf_7cc1d7ea2ec5.slice/crio-564cd063aa35df58be2339a46b52fd20c072ac90b6a6a195d78a22b670d552a3 WatchSource:0}: Error finding container 564cd063aa35df58be2339a46b52fd20c072ac90b6a6a195d78a22b670d552a3: Status 404 returned error can't find the container with id 564cd063aa35df58be2339a46b52fd20c072ac90b6a6a195d78a22b670d552a3 Jul 29 00:12:36.358010 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:36.357974 2550 generic.go:356] "Generic (PLEG): container finished" podID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerID="11dae7b98b9366964f7af4599b5357a7b0305f825a028b3d3ee3f4ddea44ef0e" exitCode=0 Jul 29 00:12:36.358200 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:36.358068 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" event={"ID":"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5","Type":"ContainerDied","Data":"11dae7b98b9366964f7af4599b5357a7b0305f825a028b3d3ee3f4ddea44ef0e"} Jul 29 00:12:36.358200 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:36.358120 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" event={"ID":"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5","Type":"ContainerStarted","Data":"564cd063aa35df58be2339a46b52fd20c072ac90b6a6a195d78a22b670d552a3"} Jul 29 00:12:37.365087 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:37.365009 2550 generic.go:356] "Generic (PLEG): container finished" podID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerID="3b4d3850b41a67d1d9577e6f225fb49429f19c3cb811f6436e97af0850e97244" exitCode=0 Jul 29 00:12:37.365087 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:37.365049 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" event={"ID":"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5","Type":"ContainerDied","Data":"3b4d3850b41a67d1d9577e6f225fb49429f19c3cb811f6436e97af0850e97244"} Jul 29 00:12:38.373010 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:38.372977 2550 generic.go:356] "Generic (PLEG): container finished" podID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerID="6c5ed624df3afb371a115701afc0aaf86299bc84b04a793411279babc7bef5a3" exitCode=0 Jul 29 00:12:38.373352 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:38.373039 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" event={"ID":"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5","Type":"ContainerDied","Data":"6c5ed624df3afb371a115701afc0aaf86299bc84b04a793411279babc7bef5a3"} Jul 29 00:12:39.500038 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.500015 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:39.536762 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.536735 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-bundle\") pod \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " Jul 29 00:12:39.536906 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.536784 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-util\") pod \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " Jul 29 00:12:39.536906 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.536868 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4hwr\" (UniqueName: \"kubernetes.io/projected/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-kube-api-access-c4hwr\") pod \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\" (UID: \"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5\") " Jul 29 00:12:39.537492 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.537468 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-bundle" (OuterVolumeSpecName: "bundle") pod "f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" (UID: "f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:12:39.539002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.538974 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-kube-api-access-c4hwr" (OuterVolumeSpecName: "kube-api-access-c4hwr") pod "f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" (UID: "f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5"). InnerVolumeSpecName "kube-api-access-c4hwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:12:39.543126 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.543023 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-util" (OuterVolumeSpecName: "util") pod "f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" (UID: "f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:12:39.637646 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.637617 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4hwr\" (UniqueName: \"kubernetes.io/projected/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-kube-api-access-c4hwr\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:39.637646 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.637645 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:39.637829 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:39.637655 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:12:40.384192 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:40.384162 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" Jul 29 00:12:40.384192 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:40.384177 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6t2g9" event={"ID":"f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5","Type":"ContainerDied","Data":"564cd063aa35df58be2339a46b52fd20c072ac90b6a6a195d78a22b670d552a3"} Jul 29 00:12:40.384383 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:40.384217 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564cd063aa35df58be2339a46b52fd20c072ac90b6a6a195d78a22b670d552a3" Jul 29 00:12:48.513704 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.513624 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr"] Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.513951 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="extract" Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.513962 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="extract" Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.513979 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="pull" Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.513985 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="pull" Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.514001 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="util" Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.514006 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="util" Jul 29 00:12:48.514062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.514060 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91126f0-69f2-4b80-afbf-7cc1d7ea2ec5" containerName="extract" Jul 29 00:12:48.516323 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.516307 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.519598 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.519574 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 00:12:48.519940 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.519921 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 00:12:48.520029 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.520010 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 00:12:48.520137 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.520120 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 00:12:48.520202 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.520125 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwq8d\"" Jul 29 00:12:48.539374 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.539354 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr"] Jul 29 00:12:48.614978 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.614940 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7103351-fd2f-4688-bb29-72e35b2a2018-tmp\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.615146 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.614997 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjl68\" (UniqueName: \"kubernetes.io/projected/a7103351-fd2f-4688-bb29-72e35b2a2018-kube-api-access-hjl68\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.615146 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.615062 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7103351-fd2f-4688-bb29-72e35b2a2018-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.615146 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.615119 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7103351-fd2f-4688-bb29-72e35b2a2018-manifests\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.615266 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.615161 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7103351-fd2f-4688-bb29-72e35b2a2018-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.716324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.716296 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7103351-fd2f-4688-bb29-72e35b2a2018-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.716324 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.716326 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7103351-fd2f-4688-bb29-72e35b2a2018-manifests\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.716516 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.716352 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7103351-fd2f-4688-bb29-72e35b2a2018-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.716516 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.716392 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7103351-fd2f-4688-bb29-72e35b2a2018-tmp\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.716516 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.716440 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjl68\" (UniqueName: \"kubernetes.io/projected/a7103351-fd2f-4688-bb29-72e35b2a2018-kube-api-access-hjl68\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.716838 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.716809 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7103351-fd2f-4688-bb29-72e35b2a2018-manifests\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.718567 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.718534 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7103351-fd2f-4688-bb29-72e35b2a2018-tmp\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.718826 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.718806 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7103351-fd2f-4688-bb29-72e35b2a2018-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.718948 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.718929 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7103351-fd2f-4688-bb29-72e35b2a2018-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.724794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.724777 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjl68\" (UniqueName: \"kubernetes.io/projected/a7103351-fd2f-4688-bb29-72e35b2a2018-kube-api-access-hjl68\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-b7rrr\" (UID: \"a7103351-fd2f-4688-bb29-72e35b2a2018\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.826729 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.826656 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:48.960810 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:48.960784 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr"] Jul 29 00:12:48.963270 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:12:48.963245 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7103351_fd2f_4688_bb29_72e35b2a2018.slice/crio-c33d4d146a40421f80954952661c3182f16e3697d59008656ef5bbd8378af46b WatchSource:0}: Error finding container c33d4d146a40421f80954952661c3182f16e3697d59008656ef5bbd8378af46b: Status 404 returned error can't find the container with id c33d4d146a40421f80954952661c3182f16e3697d59008656ef5bbd8378af46b Jul 29 00:12:49.424147 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:49.424112 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" event={"ID":"a7103351-fd2f-4688-bb29-72e35b2a2018","Type":"ContainerStarted","Data":"c33d4d146a40421f80954952661c3182f16e3697d59008656ef5bbd8378af46b"} Jul 29 00:12:52.440733 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:52.440700 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" event={"ID":"a7103351-fd2f-4688-bb29-72e35b2a2018","Type":"ContainerStarted","Data":"1bf12b8631e9880409bf3bd22c4bf19aeb7843094a9782e7e53f97ac4b39fb1b"} Jul 29 00:12:53.447060 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:53.446980 2550 generic.go:356] "Generic (PLEG): container finished" podID="a7103351-fd2f-4688-bb29-72e35b2a2018" containerID="1bf12b8631e9880409bf3bd22c4bf19aeb7843094a9782e7e53f97ac4b39fb1b" exitCode=0 Jul 29 00:12:53.447425 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:53.447062 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" event={"ID":"a7103351-fd2f-4688-bb29-72e35b2a2018","Type":"ContainerDied","Data":"1bf12b8631e9880409bf3bd22c4bf19aeb7843094a9782e7e53f97ac4b39fb1b"} Jul 29 00:12:54.453228 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:54.453193 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" event={"ID":"a7103351-fd2f-4688-bb29-72e35b2a2018","Type":"ContainerStarted","Data":"41ccc39bc88ed99a87b1af75e9d4c5a343fa484313a7d7c08eab6d41944fb12f"} Jul 29 00:12:54.453608 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:54.453294 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:12:54.477244 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:12:54.477200 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" podStartSLOduration=1.897655502 podStartE2EDuration="6.47718344s" totalImagesPullingTime="3.554000346s" totalInitContainerRuntime="1.025527592s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:12:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:54.475232887 +0000 UTC m=+270.994561551" watchObservedRunningTime="2026-07-29 00:12:54.47718344 +0000 UTC m=+270.996512087" Jul 29 00:13:05.460865 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:05.460833 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-b7rrr" Jul 29 00:13:08.965462 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:08.965427 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v9khd"] Jul 29 00:13:08.985988 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:08.985960 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:08.986228 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:08.985803 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v9khd"] Jul 29 00:13:08.988957 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:08.988933 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 29 00:13:09.094473 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.094439 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pz2\" (UniqueName: \"kubernetes.io/projected/c4f8507d-92d1-4fac-9e6b-e65830ae344f-kube-api-access-r5pz2\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.094654 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.094508 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f8507d-92d1-4fac-9e6b-e65830ae344f-tls-certs\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.195325 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.195283 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f8507d-92d1-4fac-9e6b-e65830ae344f-tls-certs\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.195521 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.195392 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pz2\" (UniqueName: \"kubernetes.io/projected/c4f8507d-92d1-4fac-9e6b-e65830ae344f-kube-api-access-r5pz2\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.195521 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:13:09.195422 2550 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 29 00:13:09.195521 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:13:09.195487 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f8507d-92d1-4fac-9e6b-e65830ae344f-tls-certs podName:c4f8507d-92d1-4fac-9e6b-e65830ae344f nodeName:}" failed. No retries permitted until 2026-07-29 00:13:09.695470882 +0000 UTC m=+286.214799507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c4f8507d-92d1-4fac-9e6b-e65830ae344f-tls-certs") pod "model-serving-api-54d89bd5fc-v9khd" (UID: "c4f8507d-92d1-4fac-9e6b-e65830ae344f") : secret "model-serving-api-tls" not found Jul 29 00:13:09.206210 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.206179 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pz2\" (UniqueName: \"kubernetes.io/projected/c4f8507d-92d1-4fac-9e6b-e65830ae344f-kube-api-access-r5pz2\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.701234 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.701195 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f8507d-92d1-4fac-9e6b-e65830ae344f-tls-certs\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.703751 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.703715 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f8507d-92d1-4fac-9e6b-e65830ae344f-tls-certs\") pod \"model-serving-api-54d89bd5fc-v9khd\" (UID: \"c4f8507d-92d1-4fac-9e6b-e65830ae344f\") " pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:09.898905 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:09.898866 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:10.036806 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:10.036783 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v9khd"] Jul 29 00:13:10.038977 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:13:10.038950 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f8507d_92d1_4fac_9e6b_e65830ae344f.slice/crio-990c4901d094d8542ae76fa88203a42df423f0f208bfb6d80f621b046d655ad5 WatchSource:0}: Error finding container 990c4901d094d8542ae76fa88203a42df423f0f208bfb6d80f621b046d655ad5: Status 404 returned error can't find the container with id 990c4901d094d8542ae76fa88203a42df423f0f208bfb6d80f621b046d655ad5 Jul 29 00:13:10.532473 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:10.532440 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" event={"ID":"c4f8507d-92d1-4fac-9e6b-e65830ae344f","Type":"ContainerStarted","Data":"990c4901d094d8542ae76fa88203a42df423f0f208bfb6d80f621b046d655ad5"} Jul 29 00:13:12.544513 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:12.544475 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" event={"ID":"c4f8507d-92d1-4fac-9e6b-e65830ae344f","Type":"ContainerStarted","Data":"a7dd29cefd20c71cbb3713e90b6827ff42b4de710972e0e7918d971d68d0fcd9"} Jul 29 00:13:12.544939 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:12.544608 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:12.567382 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:12.567340 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" podStartSLOduration=2.259009895 podStartE2EDuration="4.567314984s" totalImagesPullingTime="2.308305089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:13:12.566884949 +0000 UTC m=+289.086213596" watchObservedRunningTime="2026-07-29 00:13:12.567314984 +0000 UTC m=+289.086643629" Jul 29 00:13:13.954518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.954479 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk"] Jul 29 00:13:13.957102 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.957080 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:13.960775 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.960753 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 29 00:13:13.960897 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.960797 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 29 00:13:13.960897 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.960831 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ntbtl\"" Jul 29 00:13:13.960897 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.960848 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 29 00:13:13.960897 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.960873 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 29 00:13:13.961115 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.960984 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 29 00:13:13.970246 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:13.970223 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk"] Jul 29 00:13:14.035527 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.035492 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2713c5c-3bdd-47d0-b009-4c1496df1e09-metrics-cert\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.035721 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.035576 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2713c5c-3bdd-47d0-b009-4c1496df1e09-manager-config\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.035721 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.035610 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjsf5\" (UniqueName: \"kubernetes.io/projected/c2713c5c-3bdd-47d0-b009-4c1496df1e09-kube-api-access-cjsf5\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.035721 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.035639 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2713c5c-3bdd-47d0-b009-4c1496df1e09-cert\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.136677 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.136645 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2713c5c-3bdd-47d0-b009-4c1496df1e09-metrics-cert\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.136825 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.136691 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2713c5c-3bdd-47d0-b009-4c1496df1e09-manager-config\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.136825 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.136794 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjsf5\" (UniqueName: \"kubernetes.io/projected/c2713c5c-3bdd-47d0-b009-4c1496df1e09-kube-api-access-cjsf5\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.136825 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.136819 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2713c5c-3bdd-47d0-b009-4c1496df1e09-cert\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.137425 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.137403 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2713c5c-3bdd-47d0-b009-4c1496df1e09-manager-config\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.139172 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.139148 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2713c5c-3bdd-47d0-b009-4c1496df1e09-metrics-cert\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.139262 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.139234 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2713c5c-3bdd-47d0-b009-4c1496df1e09-cert\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.148087 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.148065 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjsf5\" (UniqueName: \"kubernetes.io/projected/c2713c5c-3bdd-47d0-b009-4c1496df1e09-kube-api-access-cjsf5\") pod \"lws-controller-manager-794d6b68f4-tq4mk\" (UID: \"c2713c5c-3bdd-47d0-b009-4c1496df1e09\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.267505 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.267422 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:14.391919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.391882 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk"] Jul 29 00:13:14.394621 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:13:14.394598 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2713c5c_3bdd_47d0_b009_4c1496df1e09.slice/crio-61e5ccb6d4371014ed903dd1521a2f402d1f393eee6431dd14622c9b67c77e73 WatchSource:0}: Error finding container 61e5ccb6d4371014ed903dd1521a2f402d1f393eee6431dd14622c9b67c77e73: Status 404 returned error can't find the container with id 61e5ccb6d4371014ed903dd1521a2f402d1f393eee6431dd14622c9b67c77e73 Jul 29 00:13:14.556628 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:14.556510 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" event={"ID":"c2713c5c-3bdd-47d0-b009-4c1496df1e09","Type":"ContainerStarted","Data":"61e5ccb6d4371014ed903dd1521a2f402d1f393eee6431dd14622c9b67c77e73"} Jul 29 00:13:16.569151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:16.569065 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" event={"ID":"c2713c5c-3bdd-47d0-b009-4c1496df1e09","Type":"ContainerStarted","Data":"9be5ef9014579c19062c04f30c390f65cdfefed08d42d5c066110d1c34f8a19c"} Jul 29 00:13:16.569518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:16.569189 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:13:16.587795 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:16.587749 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" podStartSLOduration=1.6981079129999999 podStartE2EDuration="3.587732883s" totalImagesPullingTime="1.88962497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:13:16.586470914 +0000 UTC m=+293.105799560" watchObservedRunningTime="2026-07-29 00:13:16.587732883 +0000 UTC m=+293.107061529" Jul 29 00:13:18.759273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.759235 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg"] Jul 29 00:13:18.761915 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.761894 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.765031 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.764971 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 00:13:18.765210 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.765192 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 29 00:13:18.766041 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.766010 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 29 00:13:18.766268 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.766251 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 00:13:18.766362 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.766320 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w4rkp\"" Jul 29 00:13:18.774486 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.774466 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05767711-4ab6-403d-83fb-ee5982db9dea-tls-certs\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.774589 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.774492 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05767711-4ab6-403d-83fb-ee5982db9dea-tmp\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.774637 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.774615 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qpx\" (UniqueName: \"kubernetes.io/projected/05767711-4ab6-403d-83fb-ee5982db9dea-kube-api-access-z9qpx\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.777832 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.777810 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg"] Jul 29 00:13:18.875149 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.875119 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qpx\" (UniqueName: \"kubernetes.io/projected/05767711-4ab6-403d-83fb-ee5982db9dea-kube-api-access-z9qpx\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.875309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.875187 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05767711-4ab6-403d-83fb-ee5982db9dea-tls-certs\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.875309 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.875214 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05767711-4ab6-403d-83fb-ee5982db9dea-tmp\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.875391 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:13:18.875325 2550 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 29 00:13:18.875391 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:13:18.875386 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05767711-4ab6-403d-83fb-ee5982db9dea-tls-certs podName:05767711-4ab6-403d-83fb-ee5982db9dea nodeName:}" failed. No retries permitted until 2026-07-29 00:13:19.375370404 +0000 UTC m=+295.894699028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/05767711-4ab6-403d-83fb-ee5982db9dea-tls-certs") pod "kube-auth-proxy-6998fb56fc-g72vg" (UID: "05767711-4ab6-403d-83fb-ee5982db9dea") : secret "kube-auth-proxy-tls" not found Jul 29 00:13:18.877390 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.877363 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05767711-4ab6-403d-83fb-ee5982db9dea-tmp\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:18.884601 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:18.884579 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qpx\" (UniqueName: \"kubernetes.io/projected/05767711-4ab6-403d-83fb-ee5982db9dea-kube-api-access-z9qpx\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:19.379264 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:19.379219 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05767711-4ab6-403d-83fb-ee5982db9dea-tls-certs\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:19.381639 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:19.381612 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05767711-4ab6-403d-83fb-ee5982db9dea-tls-certs\") pod \"kube-auth-proxy-6998fb56fc-g72vg\" (UID: \"05767711-4ab6-403d-83fb-ee5982db9dea\") " pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:19.671567 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:19.671528 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" Jul 29 00:13:19.800529 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:19.800460 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg"] Jul 29 00:13:19.802742 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:13:19.802714 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05767711_4ab6_403d_83fb_ee5982db9dea.slice/crio-928ac15bd89115eae21e60a9bbe1fbf9f805dfaeefc5038289a72548e9c8343a WatchSource:0}: Error finding container 928ac15bd89115eae21e60a9bbe1fbf9f805dfaeefc5038289a72548e9c8343a: Status 404 returned error can't find the container with id 928ac15bd89115eae21e60a9bbe1fbf9f805dfaeefc5038289a72548e9c8343a Jul 29 00:13:20.590543 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:20.590479 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" event={"ID":"05767711-4ab6-403d-83fb-ee5982db9dea","Type":"ContainerStarted","Data":"928ac15bd89115eae21e60a9bbe1fbf9f805dfaeefc5038289a72548e9c8343a"} Jul 29 00:13:22.601355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:22.601269 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" event={"ID":"05767711-4ab6-403d-83fb-ee5982db9dea","Type":"ContainerStarted","Data":"7acb140b31669f5592334a1a0fa65033a06d3ecb09974040f6c342842466ef27"} Jul 29 00:13:22.620707 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:22.620661 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6998fb56fc-g72vg" podStartSLOduration=2.1900447339999998 podStartE2EDuration="4.620644791s" totalImagesPullingTime="2.430600057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:13:22.619291649 +0000 UTC m=+299.138620295" watchObservedRunningTime="2026-07-29 00:13:22.620644791 +0000 UTC m=+299.139973457" Jul 29 00:13:23.552977 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:23.552946 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-v9khd" Jul 29 00:13:23.918234 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:23.918197 2550 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 00:13:27.576977 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:13:27.576943 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-tq4mk" Jul 29 00:14:26.134909 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.134876 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s"] Jul 29 00:14:26.137543 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.137528 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.139985 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.139967 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 00:14:26.141062 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.141044 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wdk9t\"" Jul 29 00:14:26.141212 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.141086 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 00:14:26.148596 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.148542 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s"] Jul 29 00:14:26.261945 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.261903 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.261945 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.261952 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.262150 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.262030 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w45kz\" (UniqueName: \"kubernetes.io/projected/7a614c93-0122-4606-bdb1-119bfc0e36ce-kube-api-access-w45kz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.362879 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.362851 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.363038 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.362884 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.363038 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.362938 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w45kz\" (UniqueName: \"kubernetes.io/projected/7a614c93-0122-4606-bdb1-119bfc0e36ce-kube-api-access-w45kz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.363316 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.363292 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.363399 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.363304 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.371475 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.371448 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w45kz\" (UniqueName: \"kubernetes.io/projected/7a614c93-0122-4606-bdb1-119bfc0e36ce-kube-api-access-w45kz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.454772 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.454704 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:26.525172 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.525143 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6"] Jul 29 00:14:26.528087 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.528067 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.537921 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.537852 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6"] Jul 29 00:14:26.602822 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.602799 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s"] Jul 29 00:14:26.604666 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:14:26.604645 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a614c93_0122_4606_bdb1_119bfc0e36ce.slice/crio-93b3f19b7a1d3cceda11e3b3acde030494abb7cb69ec9b35b1c333f27f324701 WatchSource:0}: Error finding container 93b3f19b7a1d3cceda11e3b3acde030494abb7cb69ec9b35b1c333f27f324701: Status 404 returned error can't find the container with id 93b3f19b7a1d3cceda11e3b3acde030494abb7cb69ec9b35b1c333f27f324701 Jul 29 00:14:26.665812 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.665785 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.665918 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.665827 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdsm7\" (UniqueName: \"kubernetes.io/projected/9cb0ac2f-7b2f-4978-a99c-937da3063c68-kube-api-access-kdsm7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.666010 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.665982 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.767477 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.767445 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.767647 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.767487 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdsm7\" (UniqueName: \"kubernetes.io/projected/9cb0ac2f-7b2f-4978-a99c-937da3063c68-kube-api-access-kdsm7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.767647 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.767598 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.767879 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.767856 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.767937 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.767913 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.776278 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.776253 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdsm7\" (UniqueName: \"kubernetes.io/projected/9cb0ac2f-7b2f-4978-a99c-937da3063c68-kube-api-access-kdsm7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.840360 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.840338 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:26.908826 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.908796 2550 generic.go:356] "Generic (PLEG): container finished" podID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerID="1412120d339cfea3094def5ccb02436c6ae30be0adb0efc73bfd74b2a013b2a6" exitCode=0 Jul 29 00:14:26.908965 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.908873 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" event={"ID":"7a614c93-0122-4606-bdb1-119bfc0e36ce","Type":"ContainerDied","Data":"1412120d339cfea3094def5ccb02436c6ae30be0adb0efc73bfd74b2a013b2a6"} Jul 29 00:14:26.908965 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.908919 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" event={"ID":"7a614c93-0122-4606-bdb1-119bfc0e36ce","Type":"ContainerStarted","Data":"93b3f19b7a1d3cceda11e3b3acde030494abb7cb69ec9b35b1c333f27f324701"} Jul 29 00:14:26.909370 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.909354 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 00:14:26.928078 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.928040 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm"] Jul 29 00:14:26.936850 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.936828 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:26.939593 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.939567 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm"] Jul 29 00:14:26.969767 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:26.969737 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6"] Jul 29 00:14:26.971023 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:14:26.971002 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb0ac2f_7b2f_4978_a99c_937da3063c68.slice/crio-073846145f1357844f29fe7fd10aeb47a4a936c3c68cb972b6b2c174f4ff168f WatchSource:0}: Error finding container 073846145f1357844f29fe7fd10aeb47a4a936c3c68cb972b6b2c174f4ff168f: Status 404 returned error can't find the container with id 073846145f1357844f29fe7fd10aeb47a4a936c3c68cb972b6b2c174f4ff168f Jul 29 00:14:27.071290 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.071256 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.071407 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.071304 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.071407 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.071337 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj8v4\" (UniqueName: \"kubernetes.io/projected/d16644df-9040-46c5-a363-2b86c2fd4286-kube-api-access-pj8v4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.172406 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.172379 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.172837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.172420 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.172837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.172450 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj8v4\" (UniqueName: \"kubernetes.io/projected/d16644df-9040-46c5-a363-2b86c2fd4286-kube-api-access-pj8v4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.172837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.172780 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.172837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.172799 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.180791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.180772 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj8v4\" (UniqueName: \"kubernetes.io/projected/d16644df-9040-46c5-a363-2b86c2fd4286-kube-api-access-pj8v4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.248099 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.248042 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:27.327869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.327843 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6"] Jul 29 00:14:27.331729 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.331699 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.341035 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.340607 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6"] Jul 29 00:14:27.380106 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.380079 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm"] Jul 29 00:14:27.381509 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:14:27.381482 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16644df_9040_46c5_a363_2b86c2fd4286.slice/crio-8d47a3689b5898387a011588bbe96253f1ed8bfcd75baba83935ef596caa6783 WatchSource:0}: Error finding container 8d47a3689b5898387a011588bbe96253f1ed8bfcd75baba83935ef596caa6783: Status 404 returned error can't find the container with id 8d47a3689b5898387a011588bbe96253f1ed8bfcd75baba83935ef596caa6783 Jul 29 00:14:27.474931 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.474902 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.475085 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.474967 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.475085 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.475060 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w46pd\" (UniqueName: \"kubernetes.io/projected/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-kube-api-access-w46pd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.575659 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.575584 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.575808 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.575695 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.575808 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.575763 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w46pd\" (UniqueName: \"kubernetes.io/projected/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-kube-api-access-w46pd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.576079 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.575961 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.576218 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.576201 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.583797 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.583774 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w46pd\" (UniqueName: \"kubernetes.io/projected/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-kube-api-access-w46pd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.643565 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.643535 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:27.780505 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.780479 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6"] Jul 29 00:14:27.791332 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:14:27.791304 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7a0c3c_05bf_4f12_bfdd_56a39ec2d327.slice/crio-fbfb186b6f6c4543875439528f830299da225514a3ab98f9f3ffa9a6dc7508f2 WatchSource:0}: Error finding container fbfb186b6f6c4543875439528f830299da225514a3ab98f9f3ffa9a6dc7508f2: Status 404 returned error can't find the container with id fbfb186b6f6c4543875439528f830299da225514a3ab98f9f3ffa9a6dc7508f2 Jul 29 00:14:27.915518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.915487 2550 generic.go:356] "Generic (PLEG): container finished" podID="d16644df-9040-46c5-a363-2b86c2fd4286" containerID="b15732b1e7e258ee6719e14b0bdc0d27e202437228e9b0523e7d97f4fce03629" exitCode=0 Jul 29 00:14:27.915692 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.915578 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" event={"ID":"d16644df-9040-46c5-a363-2b86c2fd4286","Type":"ContainerDied","Data":"b15732b1e7e258ee6719e14b0bdc0d27e202437228e9b0523e7d97f4fce03629"} Jul 29 00:14:27.915692 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.915636 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" event={"ID":"d16644df-9040-46c5-a363-2b86c2fd4286","Type":"ContainerStarted","Data":"8d47a3689b5898387a011588bbe96253f1ed8bfcd75baba83935ef596caa6783"} Jul 29 00:14:27.917250 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.917228 2550 generic.go:356] "Generic (PLEG): container finished" podID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerID="e3c7c4015545271c03177d763393e2ea16acbbff11b908fa1f8351059410b0c5" exitCode=0 Jul 29 00:14:27.917368 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.917301 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" event={"ID":"9cb0ac2f-7b2f-4978-a99c-937da3063c68","Type":"ContainerDied","Data":"e3c7c4015545271c03177d763393e2ea16acbbff11b908fa1f8351059410b0c5"} Jul 29 00:14:27.917368 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.917354 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" event={"ID":"9cb0ac2f-7b2f-4978-a99c-937da3063c68","Type":"ContainerStarted","Data":"073846145f1357844f29fe7fd10aeb47a4a936c3c68cb972b6b2c174f4ff168f"} Jul 29 00:14:27.919323 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.919300 2550 generic.go:356] "Generic (PLEG): container finished" podID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerID="81ced6d7d0ee1997fc3f24ea8c4b1ae3a5553bbdbcad1cc7acb5249f898033c1" exitCode=0 Jul 29 00:14:27.919436 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.919362 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" event={"ID":"7a614c93-0122-4606-bdb1-119bfc0e36ce","Type":"ContainerDied","Data":"81ced6d7d0ee1997fc3f24ea8c4b1ae3a5553bbdbcad1cc7acb5249f898033c1"} Jul 29 00:14:27.921249 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.921225 2550 generic.go:356] "Generic (PLEG): container finished" podID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerID="3df766c947e90d5a30502438b6c742cdb7889fd380cb105989280f8eade99a19" exitCode=0 Jul 29 00:14:27.921337 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.921267 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" event={"ID":"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327","Type":"ContainerDied","Data":"3df766c947e90d5a30502438b6c742cdb7889fd380cb105989280f8eade99a19"} Jul 29 00:14:27.921337 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:27.921299 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" event={"ID":"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327","Type":"ContainerStarted","Data":"fbfb186b6f6c4543875439528f830299da225514a3ab98f9f3ffa9a6dc7508f2"} Jul 29 00:14:28.936320 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:28.936287 2550 generic.go:356] "Generic (PLEG): container finished" podID="d16644df-9040-46c5-a363-2b86c2fd4286" containerID="143774bcab06513bf20bd4924240c7e6cc79bc26016d49541241e7956045c88c" exitCode=0 Jul 29 00:14:28.936714 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:28.936380 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" event={"ID":"d16644df-9040-46c5-a363-2b86c2fd4286","Type":"ContainerDied","Data":"143774bcab06513bf20bd4924240c7e6cc79bc26016d49541241e7956045c88c"} Jul 29 00:14:28.938526 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:28.938504 2550 generic.go:356] "Generic (PLEG): container finished" podID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerID="9eda4f52b631ab98cb649fc8e69291f727c3c817880ab034471ae58750e92c01" exitCode=0 Jul 29 00:14:28.938660 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:28.938581 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" event={"ID":"7a614c93-0122-4606-bdb1-119bfc0e36ce","Type":"ContainerDied","Data":"9eda4f52b631ab98cb649fc8e69291f727c3c817880ab034471ae58750e92c01"} Jul 29 00:14:28.940336 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:28.940317 2550 generic.go:356] "Generic (PLEG): container finished" podID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerID="1ee697ab8a58e1e7c119c5942f222f80d25e2fb649521f57edfc398c046b6160" exitCode=0 Jul 29 00:14:28.940421 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:28.940360 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" event={"ID":"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327","Type":"ContainerDied","Data":"1ee697ab8a58e1e7c119c5942f222f80d25e2fb649521f57edfc398c046b6160"} Jul 29 00:14:29.947966 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:29.947932 2550 generic.go:356] "Generic (PLEG): container finished" podID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerID="26bdc39ec2048cd9b67a54d9c3ea94066861548f74bae49961024c441cebe7be" exitCode=0 Jul 29 00:14:29.948411 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:29.948020 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" event={"ID":"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327","Type":"ContainerDied","Data":"26bdc39ec2048cd9b67a54d9c3ea94066861548f74bae49961024c441cebe7be"} Jul 29 00:14:29.949984 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:29.949961 2550 generic.go:356] "Generic (PLEG): container finished" podID="d16644df-9040-46c5-a363-2b86c2fd4286" containerID="4696e4a4e33df682d9764357caf04a41a37fde4370efa0313ffeb678834771f0" exitCode=0 Jul 29 00:14:29.950081 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:29.950037 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" event={"ID":"d16644df-9040-46c5-a363-2b86c2fd4286","Type":"ContainerDied","Data":"4696e4a4e33df682d9764357caf04a41a37fde4370efa0313ffeb678834771f0"} Jul 29 00:14:29.951839 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:29.951822 2550 generic.go:356] "Generic (PLEG): container finished" podID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerID="4337af12baa57ecbb449d75b4055c5819debc95594d9923eabbb8508ae4a27f0" exitCode=0 Jul 29 00:14:29.951921 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:29.951890 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" event={"ID":"9cb0ac2f-7b2f-4978-a99c-937da3063c68","Type":"ContainerDied","Data":"4337af12baa57ecbb449d75b4055c5819debc95594d9923eabbb8508ae4a27f0"} Jul 29 00:14:30.082145 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.082118 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:30.198005 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.197945 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-util\") pod \"7a614c93-0122-4606-bdb1-119bfc0e36ce\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " Jul 29 00:14:30.198120 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.198019 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-bundle\") pod \"7a614c93-0122-4606-bdb1-119bfc0e36ce\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " Jul 29 00:14:30.198120 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.198060 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w45kz\" (UniqueName: \"kubernetes.io/projected/7a614c93-0122-4606-bdb1-119bfc0e36ce-kube-api-access-w45kz\") pod \"7a614c93-0122-4606-bdb1-119bfc0e36ce\" (UID: \"7a614c93-0122-4606-bdb1-119bfc0e36ce\") " Jul 29 00:14:30.198474 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.198446 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-bundle" (OuterVolumeSpecName: "bundle") pod "7a614c93-0122-4606-bdb1-119bfc0e36ce" (UID: "7a614c93-0122-4606-bdb1-119bfc0e36ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:30.200129 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.200110 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a614c93-0122-4606-bdb1-119bfc0e36ce-kube-api-access-w45kz" (OuterVolumeSpecName: "kube-api-access-w45kz") pod "7a614c93-0122-4606-bdb1-119bfc0e36ce" (UID: "7a614c93-0122-4606-bdb1-119bfc0e36ce"). InnerVolumeSpecName "kube-api-access-w45kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:14:30.204144 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.204111 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-util" (OuterVolumeSpecName: "util") pod "7a614c93-0122-4606-bdb1-119bfc0e36ce" (UID: "7a614c93-0122-4606-bdb1-119bfc0e36ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:30.299530 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.299506 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:30.299530 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.299526 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w45kz\" (UniqueName: \"kubernetes.io/projected/7a614c93-0122-4606-bdb1-119bfc0e36ce-kube-api-access-w45kz\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:30.299697 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.299536 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a614c93-0122-4606-bdb1-119bfc0e36ce-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:30.958869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.958839 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" Jul 29 00:14:30.958869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.958864 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s" event={"ID":"7a614c93-0122-4606-bdb1-119bfc0e36ce","Type":"ContainerDied","Data":"93b3f19b7a1d3cceda11e3b3acde030494abb7cb69ec9b35b1c333f27f324701"} Jul 29 00:14:30.959355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.958910 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93b3f19b7a1d3cceda11e3b3acde030494abb7cb69ec9b35b1c333f27f324701" Jul 29 00:14:30.961121 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.961100 2550 generic.go:356] "Generic (PLEG): container finished" podID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerID="be12ac9da4d2dd3003e26a2d9211233c7e97fb4c3de96d5ace2882ebfdcd5b6e" exitCode=0 Jul 29 00:14:30.961224 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:30.961164 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" event={"ID":"9cb0ac2f-7b2f-4978-a99c-937da3063c68","Type":"ContainerDied","Data":"be12ac9da4d2dd3003e26a2d9211233c7e97fb4c3de96d5ace2882ebfdcd5b6e"} Jul 29 00:14:31.118042 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.118016 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:31.120488 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.120463 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:31.208643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.208610 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-bundle\") pod \"d16644df-9040-46c5-a363-2b86c2fd4286\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " Jul 29 00:14:31.208643 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.208644 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-util\") pod \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " Jul 29 00:14:31.208847 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.208711 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-util\") pod \"d16644df-9040-46c5-a363-2b86c2fd4286\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " Jul 29 00:14:31.208847 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.208768 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-bundle\") pod \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " Jul 29 00:14:31.208847 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.208836 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w46pd\" (UniqueName: \"kubernetes.io/projected/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-kube-api-access-w46pd\") pod \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\" (UID: \"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327\") " Jul 29 00:14:31.209032 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.208880 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj8v4\" (UniqueName: \"kubernetes.io/projected/d16644df-9040-46c5-a363-2b86c2fd4286-kube-api-access-pj8v4\") pod \"d16644df-9040-46c5-a363-2b86c2fd4286\" (UID: \"d16644df-9040-46c5-a363-2b86c2fd4286\") " Jul 29 00:14:31.209190 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.209166 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-bundle" (OuterVolumeSpecName: "bundle") pod "d16644df-9040-46c5-a363-2b86c2fd4286" (UID: "d16644df-9040-46c5-a363-2b86c2fd4286"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:31.209342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.209320 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-bundle" (OuterVolumeSpecName: "bundle") pod "3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" (UID: "3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:31.211084 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.211051 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16644df-9040-46c5-a363-2b86c2fd4286-kube-api-access-pj8v4" (OuterVolumeSpecName: "kube-api-access-pj8v4") pod "d16644df-9040-46c5-a363-2b86c2fd4286" (UID: "d16644df-9040-46c5-a363-2b86c2fd4286"). InnerVolumeSpecName "kube-api-access-pj8v4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:14:31.211465 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.211445 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-kube-api-access-w46pd" (OuterVolumeSpecName: "kube-api-access-w46pd") pod "3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" (UID: "3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327"). InnerVolumeSpecName "kube-api-access-w46pd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:14:31.214563 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.214519 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-util" (OuterVolumeSpecName: "util") pod "d16644df-9040-46c5-a363-2b86c2fd4286" (UID: "d16644df-9040-46c5-a363-2b86c2fd4286"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:31.215191 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.215169 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-util" (OuterVolumeSpecName: "util") pod "3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" (UID: "3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:31.309766 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.309734 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:31.309766 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.309761 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:31.309919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.309775 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w46pd\" (UniqueName: \"kubernetes.io/projected/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-kube-api-access-w46pd\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:31.309919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.309788 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj8v4\" (UniqueName: \"kubernetes.io/projected/d16644df-9040-46c5-a363-2b86c2fd4286-kube-api-access-pj8v4\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:31.309919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.309800 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d16644df-9040-46c5-a363-2b86c2fd4286-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:31.309919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.309810 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:31.968503 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.968477 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" Jul 29 00:14:31.968503 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.968493 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6" event={"ID":"3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327","Type":"ContainerDied","Data":"fbfb186b6f6c4543875439528f830299da225514a3ab98f9f3ffa9a6dc7508f2"} Jul 29 00:14:31.968976 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.968540 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbfb186b6f6c4543875439528f830299da225514a3ab98f9f3ffa9a6dc7508f2" Jul 29 00:14:31.970521 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.970495 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" Jul 29 00:14:31.970689 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.970516 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm" event={"ID":"d16644df-9040-46c5-a363-2b86c2fd4286","Type":"ContainerDied","Data":"8d47a3689b5898387a011588bbe96253f1ed8bfcd75baba83935ef596caa6783"} Jul 29 00:14:31.970689 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:31.970571 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d47a3689b5898387a011588bbe96253f1ed8bfcd75baba83935ef596caa6783" Jul 29 00:14:32.105632 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.105610 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:32.220905 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.220820 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-bundle\") pod \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " Jul 29 00:14:32.221056 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.220938 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-util\") pod \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " Jul 29 00:14:32.221056 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.220965 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdsm7\" (UniqueName: \"kubernetes.io/projected/9cb0ac2f-7b2f-4978-a99c-937da3063c68-kube-api-access-kdsm7\") pod \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\" (UID: \"9cb0ac2f-7b2f-4978-a99c-937da3063c68\") " Jul 29 00:14:32.221645 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.221615 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-bundle" (OuterVolumeSpecName: "bundle") pod "9cb0ac2f-7b2f-4978-a99c-937da3063c68" (UID: "9cb0ac2f-7b2f-4978-a99c-937da3063c68"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:32.223160 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.223133 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb0ac2f-7b2f-4978-a99c-937da3063c68-kube-api-access-kdsm7" (OuterVolumeSpecName: "kube-api-access-kdsm7") pod "9cb0ac2f-7b2f-4978-a99c-937da3063c68" (UID: "9cb0ac2f-7b2f-4978-a99c-937da3063c68"). InnerVolumeSpecName "kube-api-access-kdsm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:14:32.225655 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.225621 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-util" (OuterVolumeSpecName: "util") pod "9cb0ac2f-7b2f-4978-a99c-937da3063c68" (UID: "9cb0ac2f-7b2f-4978-a99c-937da3063c68"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 00:14:32.322445 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.322423 2550 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-util\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:32.322445 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.322443 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdsm7\" (UniqueName: \"kubernetes.io/projected/9cb0ac2f-7b2f-4978-a99c-937da3063c68-kube-api-access-kdsm7\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:32.322600 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.322453 2550 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cb0ac2f-7b2f-4978-a99c-937da3063c68-bundle\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:14:32.977724 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.977693 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" Jul 29 00:14:32.978109 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.977721 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6" event={"ID":"9cb0ac2f-7b2f-4978-a99c-937da3063c68","Type":"ContainerDied","Data":"073846145f1357844f29fe7fd10aeb47a4a936c3c68cb972b6b2c174f4ff168f"} Jul 29 00:14:32.978109 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:14:32.977774 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="073846145f1357844f29fe7fd10aeb47a4a936c3c68cb972b6b2c174f4ff168f" Jul 29 00:15:01.415033 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.414998 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2"] Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415373 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="pull" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415385 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="pull" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415396 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="extract" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415402 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="extract" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415419 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="pull" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415425 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="pull" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415449 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="extract" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415455 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="extract" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415462 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="extract" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415467 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="extract" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415474 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415479 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415487 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415491 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415497 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415502 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415508 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="util" Jul 29 00:15:01.415510 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415514 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="util" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415526 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="extract" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415531 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="extract" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415537 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="pull" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415542 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="pull" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415559 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="pull" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415564 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="pull" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415630 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327" containerName="extract" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415640 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16644df-9040-46c5-a363-2b86c2fd4286" containerName="extract" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415647 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a614c93-0122-4606-bdb1-119bfc0e36ce" containerName="extract" Jul 29 00:15:01.416091 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.415653 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb0ac2f-7b2f-4978-a99c-937da3063c68" containerName="extract" Jul 29 00:15:01.418566 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.418523 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.421198 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.421142 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 29 00:15:01.421340 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.421317 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 00:15:01.422414 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.422391 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 00:15:01.422528 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.422424 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wdk9t\"" Jul 29 00:15:01.422528 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.422444 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 29 00:15:01.429389 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.429365 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2"] Jul 29 00:15:01.474533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.474500 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/875d4fd9-cb75-48e9-943f-483b5871ad82-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.474716 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.474571 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/875d4fd9-cb75-48e9-943f-483b5871ad82-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.474716 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.474651 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw6dc\" (UniqueName: \"kubernetes.io/projected/875d4fd9-cb75-48e9-943f-483b5871ad82-kube-api-access-jw6dc\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.575313 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.575283 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/875d4fd9-cb75-48e9-943f-483b5871ad82-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.575499 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.575330 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw6dc\" (UniqueName: \"kubernetes.io/projected/875d4fd9-cb75-48e9-943f-483b5871ad82-kube-api-access-jw6dc\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.575499 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.575387 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/875d4fd9-cb75-48e9-943f-483b5871ad82-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.576050 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.576029 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/875d4fd9-cb75-48e9-943f-483b5871ad82-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.577726 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.577702 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/875d4fd9-cb75-48e9-943f-483b5871ad82-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.583247 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.583228 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw6dc\" (UniqueName: \"kubernetes.io/projected/875d4fd9-cb75-48e9-943f-483b5871ad82-kube-api-access-jw6dc\") pod \"kuadrant-console-plugin-66b5774985-s4sz2\" (UID: \"875d4fd9-cb75-48e9-943f-483b5871ad82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.728532 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.728455 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" Jul 29 00:15:01.859232 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:01.859209 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2"] Jul 29 00:15:01.861066 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:15:01.861041 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod875d4fd9_cb75_48e9_943f_483b5871ad82.slice/crio-6a9538f83661c8b69b25b35fb5b84775d8acd0209beedff63cd64df6e56916cc WatchSource:0}: Error finding container 6a9538f83661c8b69b25b35fb5b84775d8acd0209beedff63cd64df6e56916cc: Status 404 returned error can't find the container with id 6a9538f83661c8b69b25b35fb5b84775d8acd0209beedff63cd64df6e56916cc Jul 29 00:15:02.123637 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:02.123561 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" event={"ID":"875d4fd9-cb75-48e9-943f-483b5871ad82","Type":"ContainerStarted","Data":"6a9538f83661c8b69b25b35fb5b84775d8acd0209beedff63cd64df6e56916cc"} Jul 29 00:15:24.263286 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:24.263253 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" event={"ID":"875d4fd9-cb75-48e9-943f-483b5871ad82","Type":"ContainerStarted","Data":"02db6e241ea4e90086c01b4f472bd2cc24c504e8fdb06e90f8b671b5dda170fc"} Jul 29 00:15:24.281193 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:24.281147 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4sz2" podStartSLOduration=0.976200293 podStartE2EDuration="23.28113127s" totalImagesPullingTime="22.304930977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:15:24.279595559 +0000 UTC m=+420.798924223" watchObservedRunningTime="2026-07-29 00:15:24.28113127 +0000 UTC m=+420.800459934" Jul 29 00:15:52.403134 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.403066 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:15:52.433229 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.433198 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:15:52.433229 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.433231 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:15:52.433407 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.433302 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.435830 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.435807 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 29 00:15:52.564014 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.563981 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcmkp\" (UniqueName: \"kubernetes.io/projected/39107a55-f9e9-43d5-9a50-dabd8b41b748-kube-api-access-kcmkp\") pod \"limitador-limitador-54d6d988d5-kc4jf\" (UID: \"39107a55-f9e9-43d5-9a50-dabd8b41b748\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.564181 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.564034 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39107a55-f9e9-43d5-9a50-dabd8b41b748-config-file\") pod \"limitador-limitador-54d6d988d5-kc4jf\" (UID: \"39107a55-f9e9-43d5-9a50-dabd8b41b748\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.665232 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.665132 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcmkp\" (UniqueName: \"kubernetes.io/projected/39107a55-f9e9-43d5-9a50-dabd8b41b748-kube-api-access-kcmkp\") pod \"limitador-limitador-54d6d988d5-kc4jf\" (UID: \"39107a55-f9e9-43d5-9a50-dabd8b41b748\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.665418 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.665229 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39107a55-f9e9-43d5-9a50-dabd8b41b748-config-file\") pod \"limitador-limitador-54d6d988d5-kc4jf\" (UID: \"39107a55-f9e9-43d5-9a50-dabd8b41b748\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.665892 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.665868 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39107a55-f9e9-43d5-9a50-dabd8b41b748-config-file\") pod \"limitador-limitador-54d6d988d5-kc4jf\" (UID: \"39107a55-f9e9-43d5-9a50-dabd8b41b748\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.676495 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.676472 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcmkp\" (UniqueName: \"kubernetes.io/projected/39107a55-f9e9-43d5-9a50-dabd8b41b748-kube-api-access-kcmkp\") pod \"limitador-limitador-54d6d988d5-kc4jf\" (UID: \"39107a55-f9e9-43d5-9a50-dabd8b41b748\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.742885 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.742865 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:52.793516 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.793487 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qk7bj"] Jul 29 00:15:52.798011 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.797988 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:15:52.800981 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.800880 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8t4kk\"" Jul 29 00:15:52.804442 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.802689 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qk7bj"] Jul 29 00:15:52.881315 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.881289 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:15:52.884134 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:15:52.884109 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39107a55_f9e9_43d5_9a50_dabd8b41b748.slice/crio-f4351a5f1ff6db4c94786885cb79acb334b235a8e5e8e6321bbdbf48708b019d WatchSource:0}: Error finding container f4351a5f1ff6db4c94786885cb79acb334b235a8e5e8e6321bbdbf48708b019d: Status 404 returned error can't find the container with id f4351a5f1ff6db4c94786885cb79acb334b235a8e5e8e6321bbdbf48708b019d Jul 29 00:15:52.968216 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:52.968147 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqrb\" (UniqueName: \"kubernetes.io/projected/0375370c-e016-40b5-bcb9-f88b736ce9a0-kube-api-access-4mqrb\") pod \"authorino-75d556bd77-qk7bj\" (UID: \"0375370c-e016-40b5-bcb9-f88b736ce9a0\") " pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:15:53.069503 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:53.069472 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqrb\" (UniqueName: \"kubernetes.io/projected/0375370c-e016-40b5-bcb9-f88b736ce9a0-kube-api-access-4mqrb\") pod \"authorino-75d556bd77-qk7bj\" (UID: \"0375370c-e016-40b5-bcb9-f88b736ce9a0\") " pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:15:53.078079 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:53.078056 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqrb\" (UniqueName: \"kubernetes.io/projected/0375370c-e016-40b5-bcb9-f88b736ce9a0-kube-api-access-4mqrb\") pod \"authorino-75d556bd77-qk7bj\" (UID: \"0375370c-e016-40b5-bcb9-f88b736ce9a0\") " pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:15:53.112730 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:53.112708 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:15:53.321749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:53.321723 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qk7bj"] Jul 29 00:15:53.323366 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:15:53.323323 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0375370c_e016_40b5_bcb9_f88b736ce9a0.slice/crio-a5713b9f42616d8344d6be8af1356acb4be8e5e9b40e6cdc85b224df0ee3b237 WatchSource:0}: Error finding container a5713b9f42616d8344d6be8af1356acb4be8e5e9b40e6cdc85b224df0ee3b237: Status 404 returned error can't find the container with id a5713b9f42616d8344d6be8af1356acb4be8e5e9b40e6cdc85b224df0ee3b237 Jul 29 00:15:53.414177 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:53.414131 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qk7bj" event={"ID":"0375370c-e016-40b5-bcb9-f88b736ce9a0","Type":"ContainerStarted","Data":"a5713b9f42616d8344d6be8af1356acb4be8e5e9b40e6cdc85b224df0ee3b237"} Jul 29 00:15:53.416280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:53.416233 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" event={"ID":"39107a55-f9e9-43d5-9a50-dabd8b41b748","Type":"ContainerStarted","Data":"f4351a5f1ff6db4c94786885cb79acb334b235a8e5e8e6321bbdbf48708b019d"} Jul 29 00:15:58.449841 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:58.449805 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qk7bj" event={"ID":"0375370c-e016-40b5-bcb9-f88b736ce9a0","Type":"ContainerStarted","Data":"9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884"} Jul 29 00:15:58.451349 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:58.451320 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" event={"ID":"39107a55-f9e9-43d5-9a50-dabd8b41b748","Type":"ContainerStarted","Data":"899fd0d365a4b171be62616c0718df6699b787f0a9aed110d31770e9e3e2e41b"} Jul 29 00:15:58.451451 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:58.451406 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:15:58.481163 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:58.481119 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qk7bj" podStartSLOduration=2.292999536 podStartE2EDuration="6.481100576s" totalImagesPullingTime="4.18810104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:15:58.463659622 +0000 UTC m=+454.982988268" watchObservedRunningTime="2026-07-29 00:15:58.481100576 +0000 UTC m=+455.000429227" Jul 29 00:15:58.481898 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:15:58.481866 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" podStartSLOduration=1.866131589 podStartE2EDuration="6.481855133s" totalImagesPullingTime="4.615723544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:15:58.479828634 +0000 UTC m=+454.999157281" watchObservedRunningTime="2026-07-29 00:15:58.481855133 +0000 UTC m=+455.001183779" Jul 29 00:16:09.457589 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:09.457537 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kc4jf" Jul 29 00:16:27.508835 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:27.508803 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qk7bj"] Jul 29 00:16:27.509373 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:27.508976 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qk7bj" podUID="0375370c-e016-40b5-bcb9-f88b736ce9a0" containerName="authorino" containerID="cri-o://9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884" gracePeriod=30 Jul 29 00:16:27.789710 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:27.789653 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:16:27.875741 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:27.875710 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mqrb\" (UniqueName: \"kubernetes.io/projected/0375370c-e016-40b5-bcb9-f88b736ce9a0-kube-api-access-4mqrb\") pod \"0375370c-e016-40b5-bcb9-f88b736ce9a0\" (UID: \"0375370c-e016-40b5-bcb9-f88b736ce9a0\") " Jul 29 00:16:27.877853 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:27.877819 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0375370c-e016-40b5-bcb9-f88b736ce9a0-kube-api-access-4mqrb" (OuterVolumeSpecName: "kube-api-access-4mqrb") pod "0375370c-e016-40b5-bcb9-f88b736ce9a0" (UID: "0375370c-e016-40b5-bcb9-f88b736ce9a0"). InnerVolumeSpecName "kube-api-access-4mqrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:16:27.976359 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:27.976327 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mqrb\" (UniqueName: \"kubernetes.io/projected/0375370c-e016-40b5-bcb9-f88b736ce9a0-kube-api-access-4mqrb\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:16:28.616318 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.616279 2550 generic.go:356] "Generic (PLEG): container finished" podID="0375370c-e016-40b5-bcb9-f88b736ce9a0" containerID="9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884" exitCode=0 Jul 29 00:16:28.616318 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.616318 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qk7bj" Jul 29 00:16:28.616791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.616325 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qk7bj" event={"ID":"0375370c-e016-40b5-bcb9-f88b736ce9a0","Type":"ContainerDied","Data":"9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884"} Jul 29 00:16:28.616791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.616377 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qk7bj" event={"ID":"0375370c-e016-40b5-bcb9-f88b736ce9a0","Type":"ContainerDied","Data":"a5713b9f42616d8344d6be8af1356acb4be8e5e9b40e6cdc85b224df0ee3b237"} Jul 29 00:16:28.616791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.616394 2550 scope.go:117] "RemoveContainer" containerID="9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884" Jul 29 00:16:28.632785 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.632757 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qk7bj"] Jul 29 00:16:28.636605 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.636589 2550 scope.go:117] "RemoveContainer" containerID="9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884" Jul 29 00:16:28.636748 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.636732 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qk7bj"] Jul 29 00:16:28.636880 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:16:28.636863 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884\": container with ID starting with 9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884 not found: ID does not exist" containerID="9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884" Jul 29 00:16:28.636933 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:28.636888 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884"} err="failed to get container status \"9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884\": rpc error: code = NotFound desc = could not find container \"9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884\": container with ID starting with 9cc1d046b9499c127d8f515383819890750f8d2ac8c956819b032c86bae92884 not found: ID does not exist" Jul 29 00:16:30.116948 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:16:30.116918 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0375370c-e016-40b5-bcb9-f88b736ce9a0" path="/var/lib/kubelet/pods/0375370c-e016-40b5-bcb9-f88b736ce9a0/volumes" Jul 29 00:17:09.330690 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:17:09.330657 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:17:26.121348 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:17:26.121314 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:17:43.021045 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:17:43.021012 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:17:55.308098 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:17:55.308059 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:18:04.612184 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.612145 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz"] Jul 29 00:18:04.612688 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.612578 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0375370c-e016-40b5-bcb9-f88b736ce9a0" containerName="authorino" Jul 29 00:18:04.612688 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.612590 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0375370c-e016-40b5-bcb9-f88b736ce9a0" containerName="authorino" Jul 29 00:18:04.612688 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.612675 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0375370c-e016-40b5-bcb9-f88b736ce9a0" containerName="authorino" Jul 29 00:18:04.615965 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.615946 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.619706 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.619682 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 29 00:18:04.619829 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.619739 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 29 00:18:04.619902 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.619755 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gmvtm\"" Jul 29 00:18:04.619902 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.619853 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 29 00:18:04.623404 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.623381 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz"] Jul 29 00:18:04.732058 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.732033 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebf57a72-79c0-496c-b287-0e580e84030f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.732058 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.732064 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.732280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.732086 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.732280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.732170 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.732280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.732217 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckz8q\" (UniqueName: \"kubernetes.io/projected/ebf57a72-79c0-496c-b287-0e580e84030f-kube-api-access-ckz8q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.732395 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.732311 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.832893 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.832861 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebf57a72-79c0-496c-b287-0e580e84030f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.832893 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.832895 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833113 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.832918 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833113 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.832971 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833113 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.833021 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckz8q\" (UniqueName: \"kubernetes.io/projected/ebf57a72-79c0-496c-b287-0e580e84030f-kube-api-access-ckz8q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833263 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.833112 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833317 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.833287 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833375 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.833319 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.833488 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.833469 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.835232 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.835212 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebf57a72-79c0-496c-b287-0e580e84030f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.835404 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.835388 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebf57a72-79c0-496c-b287-0e580e84030f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.841197 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.841175 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckz8q\" (UniqueName: \"kubernetes.io/projected/ebf57a72-79c0-496c-b287-0e580e84030f-kube-api-access-ckz8q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz\" (UID: \"ebf57a72-79c0-496c-b287-0e580e84030f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:04.928362 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:04.928333 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:05.075246 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:05.075214 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz"] Jul 29 00:18:05.083276 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:18:05.083251 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf57a72_79c0_496c_b287_0e580e84030f.slice/crio-73e56d1fc9908d246318b0d5bfd4dde892ce0e3102701d2d6c82cb3a26853fef WatchSource:0}: Error finding container 73e56d1fc9908d246318b0d5bfd4dde892ce0e3102701d2d6c82cb3a26853fef: Status 404 returned error can't find the container with id 73e56d1fc9908d246318b0d5bfd4dde892ce0e3102701d2d6c82cb3a26853fef Jul 29 00:18:05.129570 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:05.129518 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" event={"ID":"ebf57a72-79c0-496c-b287-0e580e84030f","Type":"ContainerStarted","Data":"73e56d1fc9908d246318b0d5bfd4dde892ce0e3102701d2d6c82cb3a26853fef"} Jul 29 00:18:06.135464 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:06.135424 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" event={"ID":"ebf57a72-79c0-496c-b287-0e580e84030f","Type":"ContainerStarted","Data":"fb56ab77a8cc7485d165c1bd9060273e4f1004f2bc2360a6fa4313f3526a2254"} Jul 29 00:18:06.154762 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:06.154713 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" podStartSLOduration=1.174812528 podStartE2EDuration="2.154696s" totalImagesPullingTime="979.883472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:18:06.152718312 +0000 UTC m=+582.672046979" watchObservedRunningTime="2026-07-29 00:18:06.154696 +0000 UTC m=+582.674024624" Jul 29 00:18:06.234141 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:06.234108 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:18:14.928465 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:14.928430 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:14.928969 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:14.928492 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:14.940970 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:14.940943 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:15.191828 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:15.191751 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz" Jul 29 00:18:24.917737 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:24.917688 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:18:38.714648 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:18:38.714612 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:19:39.194609 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.194575 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64767b87f8-xb9qx"] Jul 29 00:19:39.197052 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.197035 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.200720 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.200700 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 29 00:19:39.200849 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.200701 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8t4kk\"" Jul 29 00:19:39.205446 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.205424 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64767b87f8-xb9qx"] Jul 29 00:19:39.357652 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.357619 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d391be09-b027-48c1-8f58-c3275e61bd1a-tls-cert\") pod \"authorino-64767b87f8-xb9qx\" (UID: \"d391be09-b027-48c1-8f58-c3275e61bd1a\") " pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.357839 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.357667 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpts2\" (UniqueName: \"kubernetes.io/projected/d391be09-b027-48c1-8f58-c3275e61bd1a-kube-api-access-hpts2\") pod \"authorino-64767b87f8-xb9qx\" (UID: \"d391be09-b027-48c1-8f58-c3275e61bd1a\") " pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.459097 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.459027 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d391be09-b027-48c1-8f58-c3275e61bd1a-tls-cert\") pod \"authorino-64767b87f8-xb9qx\" (UID: \"d391be09-b027-48c1-8f58-c3275e61bd1a\") " pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.459097 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.459064 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpts2\" (UniqueName: \"kubernetes.io/projected/d391be09-b027-48c1-8f58-c3275e61bd1a-kube-api-access-hpts2\") pod \"authorino-64767b87f8-xb9qx\" (UID: \"d391be09-b027-48c1-8f58-c3275e61bd1a\") " pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.461504 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.461481 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d391be09-b027-48c1-8f58-c3275e61bd1a-tls-cert\") pod \"authorino-64767b87f8-xb9qx\" (UID: \"d391be09-b027-48c1-8f58-c3275e61bd1a\") " pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.468080 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.468053 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpts2\" (UniqueName: \"kubernetes.io/projected/d391be09-b027-48c1-8f58-c3275e61bd1a-kube-api-access-hpts2\") pod \"authorino-64767b87f8-xb9qx\" (UID: \"d391be09-b027-48c1-8f58-c3275e61bd1a\") " pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.506954 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.506933 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64767b87f8-xb9qx" Jul 29 00:19:39.692837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.692811 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64767b87f8-xb9qx"] Jul 29 00:19:39.694119 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:19:39.694088 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd391be09_b027_48c1_8f58_c3275e61bd1a.slice/crio-dceb3755349dcd71099fbb4bf751ca62ccd75a14f885f38f7a5310dabcc14b1b WatchSource:0}: Error finding container dceb3755349dcd71099fbb4bf751ca62ccd75a14f885f38f7a5310dabcc14b1b: Status 404 returned error can't find the container with id dceb3755349dcd71099fbb4bf751ca62ccd75a14f885f38f7a5310dabcc14b1b Jul 29 00:19:39.695450 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:39.695429 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 00:19:40.629260 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:40.629222 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64767b87f8-xb9qx" event={"ID":"d391be09-b027-48c1-8f58-c3275e61bd1a","Type":"ContainerStarted","Data":"c4c503777e4e1ec6228e05d8d3213f8598162daa9fd42b1926c2a3a625b16f3f"} Jul 29 00:19:40.629648 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:40.629273 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64767b87f8-xb9qx" event={"ID":"d391be09-b027-48c1-8f58-c3275e61bd1a","Type":"ContainerStarted","Data":"dceb3755349dcd71099fbb4bf751ca62ccd75a14f885f38f7a5310dabcc14b1b"} Jul 29 00:19:40.651572 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:19:40.651502 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64767b87f8-xb9qx" podStartSLOduration=1.337831741 podStartE2EDuration="1.651482709s" totalImagesPullingTime="313.650968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:19:40.650625512 +0000 UTC m=+677.169954159" watchObservedRunningTime="2026-07-29 00:19:40.651482709 +0000 UTC m=+677.170811359" Jul 29 00:20:09.810528 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:20:09.810494 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:20:20.421442 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:20:20.421411 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:20:31.414760 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:20:31.414722 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:22:11.024758 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:22:11.024677 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:22:23.714346 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:22:23.714311 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:22:58.918858 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:22:58.918821 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:23:08.420641 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:23:08.420600 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:23:19.316481 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:23:19.316385 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:23:25.008666 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:23:25.008629 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:23:34.013944 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:23:34.013909 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:23:44.922996 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:23:44.922964 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:23:56.117295 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:23:56.117257 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:24:06.015253 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:24:06.015215 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:24:28.426185 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:24:28.426148 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:24:38.716001 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:24:38.715961 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:25:03.611225 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:25:03.611150 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:25:16.322802 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:25:16.322763 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:25:27.122058 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:25:27.122023 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:25:41.318342 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:25:41.318308 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:25:52.617275 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:25:52.617243 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:26:01.626512 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:26:01.626476 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:26:10.818482 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:26:10.818447 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:26:19.720885 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:26:19.720810 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:26:31.919154 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:26:31.919123 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:26:39.808401 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:26:39.808364 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:28:19.914089 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:28:19.914051 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:28:30.309893 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:28:30.309843 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:28:44.311793 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:28:44.311762 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:28:58.818353 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:28:58.818280 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:29:10.017960 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:29:10.017926 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:29:16.713326 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:29:16.713253 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:29:25.608298 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:29:25.608263 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:29:36.421837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:29:36.421801 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:29:45.849111 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:29:45.849071 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:29:56.809620 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:29:56.809586 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:30:06.206580 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:30:06.206537 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:30:20.219885 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:30:20.219854 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:30:38.316682 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:30:38.316642 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:30:47.615868 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:30:47.615793 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:31:03.412941 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:31:03.412907 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:31:20.348736 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:31:20.345340 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:32:00.631055 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:32:00.631024 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:32:14.422185 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:32:14.422153 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:32:21.229469 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:32:21.229378 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:32:35.762145 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:32:35.762107 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:32:45.931281 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:32:45.931246 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:32:55.048519 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:32:55.048479 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:33:06.438733 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:33:06.438690 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:33:15.539670 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:33:15.539631 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:33:25.129130 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:33:25.129096 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:33:37.922158 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:33:37.922118 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:33:46.835083 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:33:46.835001 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:33:56.533373 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:33:56.533338 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:34:09.222100 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:34:09.222068 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:34:18.533955 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:34:18.533925 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:34:24.930254 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:34:24.930223 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:34:41.129302 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:34:41.129269 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:34:53.129272 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:34:53.129235 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:35:02.926099 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:35:02.926064 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:35:10.155121 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:35:10.155089 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:35:22.526106 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:35:22.526027 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:35:34.024992 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:35:34.024955 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:35:44.345130 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:35:44.345093 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:35:51.131375 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:35:51.131335 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:36:21.960899 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:36:21.960860 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:36:34.117839 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:36:34.117799 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:37:07.428137 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:37:07.428102 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:37:17.718781 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:37:17.718744 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:37:41.921676 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:37:41.921642 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:37:53.159583 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:37:53.159536 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:38:17.219239 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:38:17.219162 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:38:27.917910 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:38:27.917871 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:39:38.415744 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:39:38.415709 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:39:56.105047 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:39:56.104964 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:40:04.608306 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:40:04.608271 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:40:14.410028 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:40:14.409994 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:40:54.704916 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:40:54.704884 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:41:27.512323 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:41:27.512289 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:41:53.106610 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:41:53.106576 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:42:10.611161 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:42:10.611127 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:42:26.013652 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:42:26.013617 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:42:35.009167 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:42:35.009124 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:43:20.010986 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:43:20.010955 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:43:31.415015 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:43:31.414982 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:44:18.912857 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:18.912824 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:44:42.710816 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.710784 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc"] Jul 29 00:44:42.714380 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.714360 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:42.716719 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.716696 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ad97f4\"" Jul 29 00:44:42.716842 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.716696 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ad97f4-dockercfg-w6t6f\"" Jul 29 00:44:42.724944 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.724837 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc"] Jul 29 00:44:42.768678 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.768652 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx5z9\" (UniqueName: \"kubernetes.io/projected/543d7689-74d8-454a-9683-967eb1c16e89-kube-api-access-vx5z9\") pod \"payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:42.768809 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.768694 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d7689-74d8-454a-9683-967eb1c16e89-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:42.869791 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.869764 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx5z9\" (UniqueName: \"kubernetes.io/projected/543d7689-74d8-454a-9683-967eb1c16e89-kube-api-access-vx5z9\") pod \"payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:42.869920 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.869808 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d7689-74d8-454a-9683-967eb1c16e89-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:42.870430 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.870413 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d7689-74d8-454a-9683-967eb1c16e89-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:42.877582 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:42.877545 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx5z9\" (UniqueName: \"kubernetes.io/projected/543d7689-74d8-454a-9683-967eb1c16e89-kube-api-access-vx5z9\") pod \"payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:43.027538 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:43.027459 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:43.155705 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:43.155678 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc"] Jul 29 00:44:43.157707 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:44:43.157676 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543d7689_74d8_454a_9683_967eb1c16e89.slice/crio-0824d4be351561b73e375375e927de262c38140a9081ed3bd5c9f83d878c77bb WatchSource:0}: Error finding container 0824d4be351561b73e375375e927de262c38140a9081ed3bd5c9f83d878c77bb: Status 404 returned error can't find the container with id 0824d4be351561b73e375375e927de262c38140a9081ed3bd5c9f83d878c77bb Jul 29 00:44:43.159999 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:43.159983 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 00:44:43.481609 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:43.481574 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" event={"ID":"543d7689-74d8-454a-9683-967eb1c16e89","Type":"ContainerStarted","Data":"0824d4be351561b73e375375e927de262c38140a9081ed3bd5c9f83d878c77bb"} Jul 29 00:44:45.495019 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:45.494985 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" event={"ID":"543d7689-74d8-454a-9683-967eb1c16e89","Type":"ContainerStarted","Data":"5d71ffbd9db5563b0b348496ef9a17762a0b48c5fd2db7bf4f57e0f1925a4274"} Jul 29 00:44:45.495616 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:45.495276 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:44:45.518449 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:45.518400 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" podStartSLOduration=2.038785268 podStartE2EDuration="3.518383685s" totalImagesPullingTime="1.479598417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:44:45.510454453 +0000 UTC m=+2182.029783100" watchObservedRunningTime="2026-07-29 00:44:45.518383685 +0000 UTC m=+2182.037712331" Jul 29 00:44:46.412294 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:46.412256 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:44:56.502716 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:44:56.502686 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:45:00.129732 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.129694 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm"] Jul 29 00:45:00.133282 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.133266 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" Jul 29 00:45:00.135668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.135646 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\"" Jul 29 00:45:00.140879 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.140855 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm"] Jul 29 00:45:00.145414 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.145396 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" Jul 29 00:45:00.282204 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.282178 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm"] Jul 29 00:45:00.283341 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:45:00.283312 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874048e4_61e2_4404_95b0_edf35f92a590.slice/crio-e18e4a609e83efc6b0ad9ee0aba189fdeb8f51991c4d6e97be2c6b766c8ffa5b WatchSource:0}: Error finding container e18e4a609e83efc6b0ad9ee0aba189fdeb8f51991c4d6e97be2c6b766c8ffa5b: Status 404 returned error can't find the container with id e18e4a609e83efc6b0ad9ee0aba189fdeb8f51991c4d6e97be2c6b766c8ffa5b Jul 29 00:45:00.573291 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:00.573209 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" event={"ID":"874048e4-61e2-4404-95b0-edf35f92a590","Type":"ContainerStarted","Data":"e18e4a609e83efc6b0ad9ee0aba189fdeb8f51991c4d6e97be2c6b766c8ffa5b"} Jul 29 00:45:03.593001 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:03.592969 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" event={"ID":"874048e4-61e2-4404-95b0-edf35f92a590","Type":"ContainerStarted","Data":"21f36d15c930843f27c7e4a18d20b9628638530935e111dcd191970233bc0406"} Jul 29 00:45:03.608069 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:03.608023 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" podStartSLOduration=1.1540991840000001 podStartE2EDuration="3.608006943s" totalImagesPullingTime="2.453907759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:45:03.606635384 +0000 UTC m=+2200.125964042" watchObservedRunningTime="2026-07-29 00:45:03.608006943 +0000 UTC m=+2200.127335585" Jul 29 00:45:04.600221 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:04.600179 2550 generic.go:356] "Generic (PLEG): container finished" podID="874048e4-61e2-4404-95b0-edf35f92a590" containerID="21f36d15c930843f27c7e4a18d20b9628638530935e111dcd191970233bc0406" exitCode=0 Jul 29 00:45:04.600620 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:04.600267 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" event={"ID":"874048e4-61e2-4404-95b0-edf35f92a590","Type":"ContainerDied","Data":"21f36d15c930843f27c7e4a18d20b9628638530935e111dcd191970233bc0406"} Jul 29 00:45:05.734628 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:05.734604 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" Jul 29 00:45:06.611869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:06.611837 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" event={"ID":"874048e4-61e2-4404-95b0-edf35f92a590","Type":"ContainerDied","Data":"e18e4a609e83efc6b0ad9ee0aba189fdeb8f51991c4d6e97be2c6b766c8ffa5b"} Jul 29 00:45:06.611869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:06.611855 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm" Jul 29 00:45:06.612069 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:06.611885 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e18e4a609e83efc6b0ad9ee0aba189fdeb8f51991c4d6e97be2c6b766c8ffa5b" Jul 29 00:45:16.208546 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:45:16.208505 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:46:04.217127 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:04.217047 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:46:17.110665 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:17.110627 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:46:43.125180 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.125150 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn"] Jul 29 00:46:43.125711 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.125650 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="874048e4-61e2-4404-95b0-edf35f92a590" containerName="cleanup" Jul 29 00:46:43.125711 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.125669 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="874048e4-61e2-4404-95b0-edf35f92a590" containerName="cleanup" Jul 29 00:46:43.125788 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.125767 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="874048e4-61e2-4404-95b0-edf35f92a590" containerName="cleanup" Jul 29 00:46:43.128144 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.128128 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:43.130802 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.130782 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\"" Jul 29 00:46:43.130802 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.130791 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 00:46:43.135891 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.135639 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn"] Jul 29 00:46:43.210523 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.210492 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40e459ed-64de-46a8-b31a-38e2884ef01e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn\" (UID: \"40e459ed-64de-46a8-b31a-38e2884ef01e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:43.311686 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.311658 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40e459ed-64de-46a8-b31a-38e2884ef01e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn\" (UID: \"40e459ed-64de-46a8-b31a-38e2884ef01e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:43.312316 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.312298 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40e459ed-64de-46a8-b31a-38e2884ef01e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn\" (UID: \"40e459ed-64de-46a8-b31a-38e2884ef01e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:43.440497 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.440472 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:43.567995 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:43.567861 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn"] Jul 29 00:46:43.570991 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:46:43.570967 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e459ed_64de_46a8_b31a_38e2884ef01e.slice/crio-39c0b154df90075eda40de0de13fa9a3cc38addebec6662e7e4ef1e92467db05 WatchSource:0}: Error finding container 39c0b154df90075eda40de0de13fa9a3cc38addebec6662e7e4ef1e92467db05: Status 404 returned error can't find the container with id 39c0b154df90075eda40de0de13fa9a3cc38addebec6662e7e4ef1e92467db05 Jul 29 00:46:44.131582 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:44.131538 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" event={"ID":"40e459ed-64de-46a8-b31a-38e2884ef01e","Type":"ContainerStarted","Data":"075bdc9c08e0880ab460afa6aaeb85614951f3f837d23bf7635a9f1bbadc5c1c"} Jul 29 00:46:44.132044 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:44.131613 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" event={"ID":"40e459ed-64de-46a8-b31a-38e2884ef01e","Type":"ContainerStarted","Data":"39c0b154df90075eda40de0de13fa9a3cc38addebec6662e7e4ef1e92467db05"} Jul 29 00:46:44.147879 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:44.147833 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" podStartSLOduration=1.147820298 podStartE2EDuration="1.147820298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:46:44.14472498 +0000 UTC m=+2300.664053646" watchObservedRunningTime="2026-07-29 00:46:44.147820298 +0000 UTC m=+2300.667148944" Jul 29 00:46:45.138392 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:45.138360 2550 generic.go:356] "Generic (PLEG): container finished" podID="40e459ed-64de-46a8-b31a-38e2884ef01e" containerID="075bdc9c08e0880ab460afa6aaeb85614951f3f837d23bf7635a9f1bbadc5c1c" exitCode=0 Jul 29 00:46:45.138793 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:45.138410 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" event={"ID":"40e459ed-64de-46a8-b31a-38e2884ef01e","Type":"ContainerDied","Data":"075bdc9c08e0880ab460afa6aaeb85614951f3f837d23bf7635a9f1bbadc5c1c"} Jul 29 00:46:46.273617 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:46.273594 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:46.338802 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:46.338778 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40e459ed-64de-46a8-b31a-38e2884ef01e-maas-api-service-ca\") pod \"40e459ed-64de-46a8-b31a-38e2884ef01e\" (UID: \"40e459ed-64de-46a8-b31a-38e2884ef01e\") " Jul 29 00:46:46.339131 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:46.339112 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40e459ed-64de-46a8-b31a-38e2884ef01e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40e459ed-64de-46a8-b31a-38e2884ef01e" (UID: "40e459ed-64de-46a8-b31a-38e2884ef01e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 00:46:46.439370 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:46.439312 2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40e459ed-64de-46a8-b31a-38e2884ef01e-maas-api-service-ca\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:46:47.156299 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:47.156265 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" event={"ID":"40e459ed-64de-46a8-b31a-38e2884ef01e","Type":"ContainerDied","Data":"39c0b154df90075eda40de0de13fa9a3cc38addebec6662e7e4ef1e92467db05"} Jul 29 00:46:47.156502 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:47.156302 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn" Jul 29 00:46:47.156502 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:47.156333 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39c0b154df90075eda40de0de13fa9a3cc38addebec6662e7e4ef1e92467db05" Jul 29 00:46:51.346796 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:51.346763 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:46:53.834749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:53.834703 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn"] Jul 29 00:46:53.836925 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:53.836905 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-065b9c-wmxtn"] Jul 29 00:46:54.116825 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:46:54.116749 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40e459ed-64de-46a8-b31a-38e2884ef01e" path="/var/lib/kubelet/pods/40e459ed-64de-46a8-b31a-38e2884ef01e/volumes" Jul 29 00:47:02.824777 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:02.824738 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:47:11.019682 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.019648 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm"] Jul 29 00:47:11.026239 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.026214 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ad97f4-29754765-vltdm"] Jul 29 00:47:11.056625 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.056595 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc"] Jul 29 00:47:11.056885 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.056835 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" podUID="543d7689-74d8-454a-9683-967eb1c16e89" containerName="payload-pre-processing" containerID="cri-o://5d71ffbd9db5563b0b348496ef9a17762a0b48c5fd2db7bf4f57e0f1925a4274" gracePeriod=30 Jul 29 00:47:11.296073 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.295983 2550 generic.go:356] "Generic (PLEG): container finished" podID="543d7689-74d8-454a-9683-967eb1c16e89" containerID="5d71ffbd9db5563b0b348496ef9a17762a0b48c5fd2db7bf4f57e0f1925a4274" exitCode=0 Jul 29 00:47:11.296233 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.296114 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" event={"ID":"543d7689-74d8-454a-9683-967eb1c16e89","Type":"ContainerDied","Data":"5d71ffbd9db5563b0b348496ef9a17762a0b48c5fd2db7bf4f57e0f1925a4274"} Jul 29 00:47:11.318274 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.318254 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:47:11.459688 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.459655 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx5z9\" (UniqueName: \"kubernetes.io/projected/543d7689-74d8-454a-9683-967eb1c16e89-kube-api-access-vx5z9\") pod \"543d7689-74d8-454a-9683-967eb1c16e89\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " Jul 29 00:47:11.459839 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.459759 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d7689-74d8-454a-9683-967eb1c16e89-plugins-config-volume\") pod \"543d7689-74d8-454a-9683-967eb1c16e89\" (UID: \"543d7689-74d8-454a-9683-967eb1c16e89\") " Jul 29 00:47:11.460151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.460125 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543d7689-74d8-454a-9683-967eb1c16e89-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "543d7689-74d8-454a-9683-967eb1c16e89" (UID: "543d7689-74d8-454a-9683-967eb1c16e89"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 00:47:11.461819 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.461797 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543d7689-74d8-454a-9683-967eb1c16e89-kube-api-access-vx5z9" (OuterVolumeSpecName: "kube-api-access-vx5z9") pod "543d7689-74d8-454a-9683-967eb1c16e89" (UID: "543d7689-74d8-454a-9683-967eb1c16e89"). InnerVolumeSpecName "kube-api-access-vx5z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:47:11.561471 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.561397 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d7689-74d8-454a-9683-967eb1c16e89-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:47:11.561471 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:11.561422 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx5z9\" (UniqueName: \"kubernetes.io/projected/543d7689-74d8-454a-9683-967eb1c16e89-kube-api-access-vx5z9\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:47:12.116726 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:12.116692 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="874048e4-61e2-4404-95b0-edf35f92a590" path="/var/lib/kubelet/pods/874048e4-61e2-4404-95b0-edf35f92a590/volumes" Jul 29 00:47:12.302869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:12.302839 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" Jul 29 00:47:12.302869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:12.302846 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc" event={"ID":"543d7689-74d8-454a-9683-967eb1c16e89","Type":"ContainerDied","Data":"0824d4be351561b73e375375e927de262c38140a9081ed3bd5c9f83d878c77bb"} Jul 29 00:47:12.303107 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:12.302908 2550 scope.go:117] "RemoveContainer" containerID="5d71ffbd9db5563b0b348496ef9a17762a0b48c5fd2db7bf4f57e0f1925a4274" Jul 29 00:47:12.318466 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:12.318442 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc"] Jul 29 00:47:12.321586 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:12.321542 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ad97f4-d58557488-g96bc"] Jul 29 00:47:13.916729 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:13.916694 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:47:14.116681 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:14.116650 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543d7689-74d8-454a-9683-967eb1c16e89" path="/var/lib/kubelet/pods/543d7689-74d8-454a-9683-967eb1c16e89/volumes" Jul 29 00:47:22.647919 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.647886 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84"] Jul 29 00:47:22.648355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.648247 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e459ed-64de-46a8-b31a-38e2884ef01e" containerName="revoke-keys" Jul 29 00:47:22.648355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.648258 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e459ed-64de-46a8-b31a-38e2884ef01e" containerName="revoke-keys" Jul 29 00:47:22.648355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.648284 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543d7689-74d8-454a-9683-967eb1c16e89" containerName="payload-pre-processing" Jul 29 00:47:22.648355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.648290 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="543d7689-74d8-454a-9683-967eb1c16e89" containerName="payload-pre-processing" Jul 29 00:47:22.648355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.648340 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40e459ed-64de-46a8-b31a-38e2884ef01e" containerName="revoke-keys" Jul 29 00:47:22.648355 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.648349 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="543d7689-74d8-454a-9683-967eb1c16e89" containerName="payload-pre-processing" Jul 29 00:47:22.651272 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.651256 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.654329 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.654306 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4f3846-dockercfg-bjrbz\"" Jul 29 00:47:22.658580 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.654894 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4f3846\"" Jul 29 00:47:22.664935 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.664682 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84"] Jul 29 00:47:22.764687 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.764659 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hz2v\" (UniqueName: \"kubernetes.io/projected/2f09d212-424c-4c84-9aec-3f3967e04053-kube-api-access-2hz2v\") pod \"payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.764848 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.764707 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f09d212-424c-4c84-9aec-3f3967e04053-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.865202 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.865168 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hz2v\" (UniqueName: \"kubernetes.io/projected/2f09d212-424c-4c84-9aec-3f3967e04053-kube-api-access-2hz2v\") pod \"payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.865365 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.865221 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f09d212-424c-4c84-9aec-3f3967e04053-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.865948 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.865926 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f09d212-424c-4c84-9aec-3f3967e04053-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.874265 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.874239 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hz2v\" (UniqueName: \"kubernetes.io/projected/2f09d212-424c-4c84-9aec-3f3967e04053-kube-api-access-2hz2v\") pod \"payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:22.967022 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:22.966950 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:23.097712 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:23.097685 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84"] Jul 29 00:47:23.099159 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:47:23.099126 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f09d212_424c_4c84_9aec_3f3967e04053.slice/crio-c0e3e94e5205289085ad5fbe18a260745cb08c4e42976914a45dc9f4cae722f3 WatchSource:0}: Error finding container c0e3e94e5205289085ad5fbe18a260745cb08c4e42976914a45dc9f4cae722f3: Status 404 returned error can't find the container with id c0e3e94e5205289085ad5fbe18a260745cb08c4e42976914a45dc9f4cae722f3 Jul 29 00:47:23.369040 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:23.368943 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" event={"ID":"2f09d212-424c-4c84-9aec-3f3967e04053","Type":"ContainerStarted","Data":"92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807"} Jul 29 00:47:23.369040 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:23.369005 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:23.369040 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:23.369030 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" event={"ID":"2f09d212-424c-4c84-9aec-3f3967e04053","Type":"ContainerStarted","Data":"c0e3e94e5205289085ad5fbe18a260745cb08c4e42976914a45dc9f4cae722f3"} Jul 29 00:47:23.388234 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:23.388180 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" podStartSLOduration=1.3881638459999999 podStartE2EDuration="1.388163846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:23.385953203 +0000 UTC m=+2339.905281872" watchObservedRunningTime="2026-07-29 00:47:23.388163846 +0000 UTC m=+2339.907492491" Jul 29 00:47:28.908482 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:28.908447 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:47:34.376586 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:34.376535 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:47:51.869409 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.869373 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd"] Jul 29 00:47:51.872242 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.872226 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:51.874920 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.874900 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-111f37\"" Jul 29 00:47:51.882320 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.882297 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd"] Jul 29 00:47:51.920676 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.920646 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f"] Jul 29 00:47:51.923219 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.923203 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:51.926894 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.926874 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-111f37-dockercfg-n9cgc\"" Jul 29 00:47:51.934895 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:51.934874 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f"] Jul 29 00:47:52.029429 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.029399 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.029632 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.029458 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda70566-f031-4885-a39e-c26d13f91216-plugins-config-volume\") pod \"payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.029632 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.029591 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4mb\" (UniqueName: \"kubernetes.io/projected/dda70566-f031-4885-a39e-c26d13f91216-kube-api-access-cv4mb\") pod \"payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.029632 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.029617 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh57z\" (UniqueName: \"kubernetes.io/projected/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-kube-api-access-dh57z\") pod \"payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.130297 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.130272 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.130437 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.130315 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda70566-f031-4885-a39e-c26d13f91216-plugins-config-volume\") pod \"payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.130437 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.130367 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4mb\" (UniqueName: \"kubernetes.io/projected/dda70566-f031-4885-a39e-c26d13f91216-kube-api-access-cv4mb\") pod \"payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.130437 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.130382 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh57z\" (UniqueName: \"kubernetes.io/projected/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-kube-api-access-dh57z\") pod \"payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.131260 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.131238 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda70566-f031-4885-a39e-c26d13f91216-plugins-config-volume\") pod \"payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.131308 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.131238 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.138295 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.138269 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh57z\" (UniqueName: \"kubernetes.io/projected/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-kube-api-access-dh57z\") pod \"payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.139038 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.139018 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4mb\" (UniqueName: \"kubernetes.io/projected/dda70566-f031-4885-a39e-c26d13f91216-kube-api-access-cv4mb\") pod \"payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.184442 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.184414 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.233756 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.233722 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.326842 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.326816 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd"] Jul 29 00:47:52.328730 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:47:52.328698 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f61fd6_f101_4b40_9f2c_b01b7fcb062f.slice/crio-b304670ddf29a8e29db663ae65d328a848cd2ca716ed660032ab979a6dee4ffa WatchSource:0}: Error finding container b304670ddf29a8e29db663ae65d328a848cd2ca716ed660032ab979a6dee4ffa: Status 404 returned error can't find the container with id b304670ddf29a8e29db663ae65d328a848cd2ca716ed660032ab979a6dee4ffa Jul 29 00:47:52.386898 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.386873 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f"] Jul 29 00:47:52.389038 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:47:52.389014 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda70566_f031_4885_a39e_c26d13f91216.slice/crio-cc39a09d6347840600447dbf6d5804159cab3dd32f7d3402553a5dcf5f97564d WatchSource:0}: Error finding container cc39a09d6347840600447dbf6d5804159cab3dd32f7d3402553a5dcf5f97564d: Status 404 returned error can't find the container with id cc39a09d6347840600447dbf6d5804159cab3dd32f7d3402553a5dcf5f97564d Jul 29 00:47:52.529357 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.529323 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" event={"ID":"28f61fd6-f101-4b40-9f2c-b01b7fcb062f","Type":"ContainerStarted","Data":"7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce"} Jul 29 00:47:52.529536 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.529383 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" event={"ID":"28f61fd6-f101-4b40-9f2c-b01b7fcb062f","Type":"ContainerStarted","Data":"b304670ddf29a8e29db663ae65d328a848cd2ca716ed660032ab979a6dee4ffa"} Jul 29 00:47:52.529536 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.529494 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:47:52.530842 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.530821 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" event={"ID":"dda70566-f031-4885-a39e-c26d13f91216","Type":"ContainerStarted","Data":"2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f"} Jul 29 00:47:52.530913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.530860 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" event={"ID":"dda70566-f031-4885-a39e-c26d13f91216","Type":"ContainerStarted","Data":"cc39a09d6347840600447dbf6d5804159cab3dd32f7d3402553a5dcf5f97564d"} Jul 29 00:47:52.530913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.530879 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:47:52.563821 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.563776 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" podStartSLOduration=1.5637614499999999 podStartE2EDuration="1.56376145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:52.561455375 +0000 UTC m=+2369.080784044" watchObservedRunningTime="2026-07-29 00:47:52.56376145 +0000 UTC m=+2369.083090095" Jul 29 00:47:52.564120 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:52.564100 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" podStartSLOduration=1.564094774 podStartE2EDuration="1.564094774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:52.544122166 +0000 UTC m=+2369.063450831" watchObservedRunningTime="2026-07-29 00:47:52.564094774 +0000 UTC m=+2369.083423419" Jul 29 00:47:58.316782 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:47:58.316743 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:48:03.542053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:03.542022 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:48:03.542494 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:03.542233 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:48:34.302928 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.302888 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84"] Jul 29 00:48:34.303526 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.303150 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" podUID="2f09d212-424c-4c84-9aec-3f3967e04053" containerName="payload-pre-processing" containerID="cri-o://92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807" gracePeriod=30 Jul 29 00:48:34.374350 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.374301 2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" podUID="2f09d212-424c-4c84-9aec-3f3967e04053" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.39:9004: connect: connection refused" Jul 29 00:48:34.555669 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.555613 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:48:34.712790 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.712761 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hz2v\" (UniqueName: \"kubernetes.io/projected/2f09d212-424c-4c84-9aec-3f3967e04053-kube-api-access-2hz2v\") pod \"2f09d212-424c-4c84-9aec-3f3967e04053\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " Jul 29 00:48:34.712962 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.712876 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f09d212-424c-4c84-9aec-3f3967e04053-plugins-config-volume\") pod \"2f09d212-424c-4c84-9aec-3f3967e04053\" (UID: \"2f09d212-424c-4c84-9aec-3f3967e04053\") " Jul 29 00:48:34.713241 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.713216 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f09d212-424c-4c84-9aec-3f3967e04053-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f09d212-424c-4c84-9aec-3f3967e04053" (UID: "2f09d212-424c-4c84-9aec-3f3967e04053"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 00:48:34.714749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.714728 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f09d212-424c-4c84-9aec-3f3967e04053-kube-api-access-2hz2v" (OuterVolumeSpecName: "kube-api-access-2hz2v") pod "2f09d212-424c-4c84-9aec-3f3967e04053" (UID: "2f09d212-424c-4c84-9aec-3f3967e04053"). InnerVolumeSpecName "kube-api-access-2hz2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:48:34.754719 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.754689 2550 generic.go:356] "Generic (PLEG): container finished" podID="2f09d212-424c-4c84-9aec-3f3967e04053" containerID="92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807" exitCode=0 Jul 29 00:48:34.754823 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.754737 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" Jul 29 00:48:34.754823 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.754757 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" event={"ID":"2f09d212-424c-4c84-9aec-3f3967e04053","Type":"ContainerDied","Data":"92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807"} Jul 29 00:48:34.754823 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.754806 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84" event={"ID":"2f09d212-424c-4c84-9aec-3f3967e04053","Type":"ContainerDied","Data":"c0e3e94e5205289085ad5fbe18a260745cb08c4e42976914a45dc9f4cae722f3"} Jul 29 00:48:34.754936 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.754829 2550 scope.go:117] "RemoveContainer" containerID="92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807" Jul 29 00:48:34.764117 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.764097 2550 scope.go:117] "RemoveContainer" containerID="92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807" Jul 29 00:48:34.764407 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:48:34.764388 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807\": container with ID starting with 92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807 not found: ID does not exist" containerID="92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807" Jul 29 00:48:34.764451 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.764416 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807"} err="failed to get container status \"92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807\": rpc error: code = NotFound desc = could not find container \"92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807\": container with ID starting with 92ae92ae626ef91a1b8a7b7b6e2bfaf90076f8a7dcdca4ec816539a4c2181807 not found: ID does not exist" Jul 29 00:48:34.776509 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.776484 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84"] Jul 29 00:48:34.783053 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.783031 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4f3846-b54ff685b-jvs84"] Jul 29 00:48:34.814204 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.814148 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f09d212-424c-4c84-9aec-3f3967e04053-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:48:34.814204 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:34.814170 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hz2v\" (UniqueName: \"kubernetes.io/projected/2f09d212-424c-4c84-9aec-3f3967e04053-kube-api-access-2hz2v\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:48:36.117762 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:36.117727 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f09d212-424c-4c84-9aec-3f3967e04053" path="/var/lib/kubelet/pods/2f09d212-424c-4c84-9aec-3f3967e04053/volumes" Jul 29 00:48:39.011917 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:39.011875 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:48:56.806047 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:56.805960 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f"] Jul 29 00:48:56.806537 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:56.806205 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" podUID="dda70566-f031-4885-a39e-c26d13f91216" containerName="payload-processing" containerID="cri-o://2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f" gracePeriod=30 Jul 29 00:48:56.816875 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:56.816663 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd"] Jul 29 00:48:56.817003 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:56.816907 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" podUID="28f61fd6-f101-4b40-9f2c-b01b7fcb062f" containerName="payload-pre-processing" containerID="cri-o://7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce" gracePeriod=30 Jul 29 00:48:57.086086 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.086063 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:48:57.089660 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.089639 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:48:57.113563 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.113528 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda70566-f031-4885-a39e-c26d13f91216-plugins-config-volume\") pod \"dda70566-f031-4885-a39e-c26d13f91216\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " Jul 29 00:48:57.113692 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.113596 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv4mb\" (UniqueName: \"kubernetes.io/projected/dda70566-f031-4885-a39e-c26d13f91216-kube-api-access-cv4mb\") pod \"dda70566-f031-4885-a39e-c26d13f91216\" (UID: \"dda70566-f031-4885-a39e-c26d13f91216\") " Jul 29 00:48:57.113692 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.113672 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-plugins-config-volume\") pod \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " Jul 29 00:48:57.113807 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.113745 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh57z\" (UniqueName: \"kubernetes.io/projected/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-kube-api-access-dh57z\") pod \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\" (UID: \"28f61fd6-f101-4b40-9f2c-b01b7fcb062f\") " Jul 29 00:48:57.114002 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.113978 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda70566-f031-4885-a39e-c26d13f91216-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dda70566-f031-4885-a39e-c26d13f91216" (UID: "dda70566-f031-4885-a39e-c26d13f91216"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 00:48:57.114088 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.114072 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28f61fd6-f101-4b40-9f2c-b01b7fcb062f" (UID: "28f61fd6-f101-4b40-9f2c-b01b7fcb062f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 00:48:57.115749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.115721 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda70566-f031-4885-a39e-c26d13f91216-kube-api-access-cv4mb" (OuterVolumeSpecName: "kube-api-access-cv4mb") pod "dda70566-f031-4885-a39e-c26d13f91216" (UID: "dda70566-f031-4885-a39e-c26d13f91216"). InnerVolumeSpecName "kube-api-access-cv4mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:48:57.115749 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.115730 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-kube-api-access-dh57z" (OuterVolumeSpecName: "kube-api-access-dh57z") pod "28f61fd6-f101-4b40-9f2c-b01b7fcb062f" (UID: "28f61fd6-f101-4b40-9f2c-b01b7fcb062f"). InnerVolumeSpecName "kube-api-access-dh57z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:48:57.215526 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.215475 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda70566-f031-4885-a39e-c26d13f91216-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:48:57.215526 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.215518 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv4mb\" (UniqueName: \"kubernetes.io/projected/dda70566-f031-4885-a39e-c26d13f91216-kube-api-access-cv4mb\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:48:57.215526 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.215529 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:48:57.215526 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.215539 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh57z\" (UniqueName: \"kubernetes.io/projected/28f61fd6-f101-4b40-9f2c-b01b7fcb062f-kube-api-access-dh57z\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:48:57.880458 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.880422 2550 generic.go:356] "Generic (PLEG): container finished" podID="dda70566-f031-4885-a39e-c26d13f91216" containerID="2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f" exitCode=0 Jul 29 00:48:57.880947 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.880468 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" Jul 29 00:48:57.880947 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.880505 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" event={"ID":"dda70566-f031-4885-a39e-c26d13f91216","Type":"ContainerDied","Data":"2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f"} Jul 29 00:48:57.880947 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.880577 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f" event={"ID":"dda70566-f031-4885-a39e-c26d13f91216","Type":"ContainerDied","Data":"cc39a09d6347840600447dbf6d5804159cab3dd32f7d3402553a5dcf5f97564d"} Jul 29 00:48:57.880947 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.880603 2550 scope.go:117] "RemoveContainer" containerID="2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f" Jul 29 00:48:57.882070 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.882045 2550 generic.go:356] "Generic (PLEG): container finished" podID="28f61fd6-f101-4b40-9f2c-b01b7fcb062f" containerID="7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce" exitCode=0 Jul 29 00:48:57.882204 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.882079 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" Jul 29 00:48:57.882204 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.882082 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" event={"ID":"28f61fd6-f101-4b40-9f2c-b01b7fcb062f","Type":"ContainerDied","Data":"7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce"} Jul 29 00:48:57.882204 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.882139 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd" event={"ID":"28f61fd6-f101-4b40-9f2c-b01b7fcb062f","Type":"ContainerDied","Data":"b304670ddf29a8e29db663ae65d328a848cd2ca716ed660032ab979a6dee4ffa"} Jul 29 00:48:57.891514 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.891493 2550 scope.go:117] "RemoveContainer" containerID="2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f" Jul 29 00:48:57.891820 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:48:57.891800 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f\": container with ID starting with 2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f not found: ID does not exist" containerID="2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f" Jul 29 00:48:57.891870 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.891829 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f"} err="failed to get container status \"2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f\": rpc error: code = NotFound desc = could not find container \"2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f\": container with ID starting with 2d47dd8b4aaa6175bd75a2a72d13edd39371f33557874057911fb4dbf2a08d0f not found: ID does not exist" Jul 29 00:48:57.891870 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.891845 2550 scope.go:117] "RemoveContainer" containerID="7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce" Jul 29 00:48:57.900381 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.900363 2550 scope.go:117] "RemoveContainer" containerID="7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce" Jul 29 00:48:57.900664 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:48:57.900642 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce\": container with ID starting with 7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce not found: ID does not exist" containerID="7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce" Jul 29 00:48:57.900729 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.900674 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce"} err="failed to get container status \"7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce\": rpc error: code = NotFound desc = could not find container \"7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce\": container with ID starting with 7444c3e7efabf0122e9cf3208d2ba2eca15d3383ce6cbf65188750ad2cae56ce not found: ID does not exist" Jul 29 00:48:57.906319 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.906293 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f"] Jul 29 00:48:57.909184 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.909156 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-111f37-7dd7944756-mgj2f"] Jul 29 00:48:57.921611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.921586 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd"] Jul 29 00:48:57.925035 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:57.925012 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-111f37-ffd758b4-5jzdd"] Jul 29 00:48:58.116932 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:58.116899 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28f61fd6-f101-4b40-9f2c-b01b7fcb062f" path="/var/lib/kubelet/pods/28f61fd6-f101-4b40-9f2c-b01b7fcb062f/volumes" Jul 29 00:48:58.117280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:48:58.117267 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda70566-f031-4885-a39e-c26d13f91216" path="/var/lib/kubelet/pods/dda70566-f031-4885-a39e-c26d13f91216/volumes" Jul 29 00:49:01.012431 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:01.012393 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:49:08.104974 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.104938 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd"] Jul 29 00:49:08.105438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105347 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f61fd6-f101-4b40-9f2c-b01b7fcb062f" containerName="payload-pre-processing" Jul 29 00:49:08.105438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105359 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f61fd6-f101-4b40-9f2c-b01b7fcb062f" containerName="payload-pre-processing" Jul 29 00:49:08.105438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105380 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda70566-f031-4885-a39e-c26d13f91216" containerName="payload-processing" Jul 29 00:49:08.105438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105387 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda70566-f031-4885-a39e-c26d13f91216" containerName="payload-processing" Jul 29 00:49:08.105438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105401 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f09d212-424c-4c84-9aec-3f3967e04053" containerName="payload-pre-processing" Jul 29 00:49:08.105438 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105407 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f09d212-424c-4c84-9aec-3f3967e04053" containerName="payload-pre-processing" Jul 29 00:49:08.105647 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105473 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="28f61fd6-f101-4b40-9f2c-b01b7fcb062f" containerName="payload-pre-processing" Jul 29 00:49:08.105647 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105481 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda70566-f031-4885-a39e-c26d13f91216" containerName="payload-processing" Jul 29 00:49:08.105647 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.105488 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f09d212-424c-4c84-9aec-3f3967e04053" containerName="payload-pre-processing" Jul 29 00:49:08.107834 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.107817 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.110533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.110503 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-d90846-dockercfg-ptvvx\"" Jul 29 00:49:08.110533 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.110519 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-d90846\"" Jul 29 00:49:08.119584 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.119522 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd"] Jul 29 00:49:08.211838 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.211797 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pftn7\" (UniqueName: \"kubernetes.io/projected/6688b8e1-b590-4585-85df-59a2d6378f46-kube-api-access-pftn7\") pod \"payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.212007 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.211866 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6688b8e1-b590-4585-85df-59a2d6378f46-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.313338 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.313300 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pftn7\" (UniqueName: \"kubernetes.io/projected/6688b8e1-b590-4585-85df-59a2d6378f46-kube-api-access-pftn7\") pod \"payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.313508 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.313371 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6688b8e1-b590-4585-85df-59a2d6378f46-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.314078 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.314057 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6688b8e1-b590-4585-85df-59a2d6378f46-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.323090 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.323066 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pftn7\" (UniqueName: \"kubernetes.io/projected/6688b8e1-b590-4585-85df-59a2d6378f46-kube-api-access-pftn7\") pod \"payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.429384 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.429351 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.560864 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.560834 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd"] Jul 29 00:49:08.562592 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:49:08.562545 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6688b8e1_b590_4585_85df_59a2d6378f46.slice/crio-fe5fb01362011e877431780f39d76ee2243b027c14deb8223d03e4245bd9b042 WatchSource:0}: Error finding container fe5fb01362011e877431780f39d76ee2243b027c14deb8223d03e4245bd9b042: Status 404 returned error can't find the container with id fe5fb01362011e877431780f39d76ee2243b027c14deb8223d03e4245bd9b042 Jul 29 00:49:08.944934 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.944905 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" event={"ID":"6688b8e1-b590-4585-85df-59a2d6378f46","Type":"ContainerStarted","Data":"ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55"} Jul 29 00:49:08.945127 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.944953 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" event={"ID":"6688b8e1-b590-4585-85df-59a2d6378f46","Type":"ContainerStarted","Data":"fe5fb01362011e877431780f39d76ee2243b027c14deb8223d03e4245bd9b042"} Jul 29 00:49:08.945127 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.944991 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:08.960054 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:08.960010 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" podStartSLOduration=0.959996642 podStartE2EDuration="959.996642ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:49:08.959361349 +0000 UTC m=+2445.478690018" watchObservedRunningTime="2026-07-29 00:49:08.959996642 +0000 UTC m=+2445.479325287" Jul 29 00:49:11.907942 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:11.907906 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:49:19.952737 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:19.952705 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 00:49:36.369085 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.369048 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7"] Jul 29 00:49:36.372628 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.372607 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k"] Jul 29 00:49:36.372752 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.372723 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.375174 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.375153 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-12505f\"" Jul 29 00:49:36.376084 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.376066 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.378359 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.378338 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-12505f-dockercfg-smjph\"" Jul 29 00:49:36.382745 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.382722 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7"] Jul 29 00:49:36.396217 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.396190 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k"] Jul 29 00:49:36.459518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.459487 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsq86\" (UniqueName: \"kubernetes.io/projected/93738ff5-d0f2-4785-b199-61a82f5a0f8b-kube-api-access-lsq86\") pod \"payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.459518 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.459519 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-kube-api-access-ztvzr\") pod \"payload-processing-e2e-shared-b-12505f-5757887b58-jck6k\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.459710 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.459593 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93738ff5-d0f2-4785-b199-61a82f5a0f8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.459710 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.459619 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-12505f-5757887b58-jck6k\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.560869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.560840 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsq86\" (UniqueName: \"kubernetes.io/projected/93738ff5-d0f2-4785-b199-61a82f5a0f8b-kube-api-access-lsq86\") pod \"payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.560869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.560870 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-kube-api-access-ztvzr\") pod \"payload-processing-e2e-shared-b-12505f-5757887b58-jck6k\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.561068 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.560911 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93738ff5-d0f2-4785-b199-61a82f5a0f8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.561068 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.560935 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-12505f-5757887b58-jck6k\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.561633 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.561615 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-12505f-5757887b58-jck6k\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.561685 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.561636 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93738ff5-d0f2-4785-b199-61a82f5a0f8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.568679 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.568660 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsq86\" (UniqueName: \"kubernetes.io/projected/93738ff5-d0f2-4785-b199-61a82f5a0f8b-kube-api-access-lsq86\") pod \"payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.568785 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.568692 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-kube-api-access-ztvzr\") pod \"payload-processing-e2e-shared-b-12505f-5757887b58-jck6k\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.685954 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.685918 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:36.693713 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.693694 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:36.831391 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.831024 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7"] Jul 29 00:49:36.833724 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:49:36.833697 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93738ff5_d0f2_4785_b199_61a82f5a0f8b.slice/crio-64a08091513ecc41df3dd32a5232c884669df90c0dd07121eca9c1b6abec71b7 WatchSource:0}: Error finding container 64a08091513ecc41df3dd32a5232c884669df90c0dd07121eca9c1b6abec71b7: Status 404 returned error can't find the container with id 64a08091513ecc41df3dd32a5232c884669df90c0dd07121eca9c1b6abec71b7 Jul 29 00:49:36.855049 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:36.855018 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k"] Jul 29 00:49:36.856364 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:49:36.856331 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc00c9e9_ef96_4a16_b4b9_1440319e9d0f.slice/crio-84bb63e29207ca93d936dacfbe0fefc34f7d46ac49a503e3c5c2b68a66f1b450 WatchSource:0}: Error finding container 84bb63e29207ca93d936dacfbe0fefc34f7d46ac49a503e3c5c2b68a66f1b450: Status 404 returned error can't find the container with id 84bb63e29207ca93d936dacfbe0fefc34f7d46ac49a503e3c5c2b68a66f1b450 Jul 29 00:49:37.109974 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.109877 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" event={"ID":"93738ff5-d0f2-4785-b199-61a82f5a0f8b","Type":"ContainerStarted","Data":"4f9cc771c79e0f5ebf346f5a8079c23c604f4f34b088b9ac38cef0bcd10740e8"} Jul 29 00:49:37.109974 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.109935 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" event={"ID":"93738ff5-d0f2-4785-b199-61a82f5a0f8b","Type":"ContainerStarted","Data":"64a08091513ecc41df3dd32a5232c884669df90c0dd07121eca9c1b6abec71b7"} Jul 29 00:49:37.109974 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.109964 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:37.111668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.111641 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" event={"ID":"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f","Type":"ContainerStarted","Data":"ff7dc3531e920bfc3131c8412b2635e5477d98d8ded615aff69f9c1fbc8d82d4"} Jul 29 00:49:37.111804 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.111689 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" event={"ID":"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f","Type":"ContainerStarted","Data":"84bb63e29207ca93d936dacfbe0fefc34f7d46ac49a503e3c5c2b68a66f1b450"} Jul 29 00:49:37.111804 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.111716 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:49:37.126186 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.126144 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" podStartSLOduration=1.126130504 podStartE2EDuration="1.126130504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:49:37.12378734 +0000 UTC m=+2473.643116014" watchObservedRunningTime="2026-07-29 00:49:37.126130504 +0000 UTC m=+2473.645459150" Jul 29 00:49:37.139464 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:37.139406 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" podStartSLOduration=1.139383101 podStartE2EDuration="1.139383101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:49:37.139080205 +0000 UTC m=+2473.658408868" watchObservedRunningTime="2026-07-29 00:49:37.139383101 +0000 UTC m=+2473.658711748" Jul 29 00:49:40.212032 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:40.211992 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:49:48.120730 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:48.120692 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 00:49:48.123134 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:49:48.120843 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 00:50:19.209034 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:50:19.209002 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:50:52.818157 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:50:52.818125 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:51:17.106668 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:51:17.106637 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:51:24.232066 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:51:24.232034 2550 scope.go:117] "RemoveContainer" containerID="21f36d15c930843f27c7e4a18d20b9628638530935e111dcd191970233bc0406" Jul 29 00:51:43.015247 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:51:43.015209 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:52:00.549691 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:52:00.549613 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:52:23.710372 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:52:23.710329 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:52:41.410928 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:52:41.410897 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:53:03.308365 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:53:03.308328 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:53:16.809940 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:53:16.809851 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:53:24.260848 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:53:24.260819 2550 scope.go:117] "RemoveContainer" containerID="075bdc9c08e0880ab460afa6aaeb85614951f3f837d23bf7635a9f1bbadc5c1c" Jul 29 00:53:29.123273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:53:29.123228 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:53:51.415372 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:53:51.415337 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:54:08.714203 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:54:08.714168 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:54:31.113933 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:54:31.113896 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:54:48.812980 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:54:48.812948 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:55:11.415353 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:55:11.415316 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:55:27.219596 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:55:27.219542 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:56:01.213152 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:56:01.213119 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:56:30.711513 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:56:30.711479 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:56:48.508413 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:56:48.508380 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:57:07.720280 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:57:07.720243 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:57:17.609152 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:57:17.609118 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:57:32.815390 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:57:32.815356 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:58:05.012279 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:05.012201 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:58:19.008884 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:19.008850 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:58:36.205806 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:36.205770 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:58:41.993256 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:41.993224 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7666-140519451925296"] Jul 29 00:58:41.997223 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:41.997206 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:41.999744 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:41.999717 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qn88x\"" Jul 29 00:58:42.002349 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.002322 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451925296"] Jul 29 00:58:42.169815 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.169776 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfnm\" (UniqueName: \"kubernetes.io/projected/a90ebb69-b86a-4788-be37-191efdfea2a5-kube-api-access-wmfnm\") pod \"test-curl-7666-140519451925296\" (UID: \"a90ebb69-b86a-4788-be37-191efdfea2a5\") " pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:42.270825 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.270738 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfnm\" (UniqueName: \"kubernetes.io/projected/a90ebb69-b86a-4788-be37-191efdfea2a5-kube-api-access-wmfnm\") pod \"test-curl-7666-140519451925296\" (UID: \"a90ebb69-b86a-4788-be37-191efdfea2a5\") " pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:42.279869 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.279845 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfnm\" (UniqueName: \"kubernetes.io/projected/a90ebb69-b86a-4788-be37-191efdfea2a5-kube-api-access-wmfnm\") pod \"test-curl-7666-140519451925296\" (UID: \"a90ebb69-b86a-4788-be37-191efdfea2a5\") " pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:42.307692 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.307666 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:42.644973 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.644946 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451925296"] Jul 29 00:58:42.649723 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:58:42.649688 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda90ebb69_b86a_4788_be37_191efdfea2a5.slice/crio-8022e5f6e5873ab25b2b7aec3c4316d74b34d5e90a6f2d782e328176353830b1 WatchSource:0}: Error finding container 8022e5f6e5873ab25b2b7aec3c4316d74b34d5e90a6f2d782e328176353830b1: Status 404 returned error can't find the container with id 8022e5f6e5873ab25b2b7aec3c4316d74b34d5e90a6f2d782e328176353830b1 Jul 29 00:58:42.651525 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:42.651504 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 00:58:43.046213 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:43.046118 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451925296" event={"ID":"a90ebb69-b86a-4788-be37-191efdfea2a5","Type":"ContainerStarted","Data":"8022e5f6e5873ab25b2b7aec3c4316d74b34d5e90a6f2d782e328176353830b1"} Jul 29 00:58:44.053376 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:44.053345 2550 generic.go:356] "Generic (PLEG): container finished" podID="a90ebb69-b86a-4788-be37-191efdfea2a5" containerID="af31f15b70583b5d1f2883304b7e25441574090862b4cd01a7362db1ef8a6232" exitCode=0 Jul 29 00:58:44.053785 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:44.053442 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451925296" event={"ID":"a90ebb69-b86a-4788-be37-191efdfea2a5","Type":"ContainerDied","Data":"af31f15b70583b5d1f2883304b7e25441574090862b4cd01a7362db1ef8a6232"} Jul 29 00:58:45.190073 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.190044 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:45.223970 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.223939 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7666-140519451925296_a90ebb69-b86a-4788-be37-191efdfea2a5/test-curl-7666-140519451925296/0.log" Jul 29 00:58:45.249310 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.249284 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7666-140519451925296"] Jul 29 00:58:45.254901 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.254874 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7666-140519451925296"] Jul 29 00:58:45.298927 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.298898 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmfnm\" (UniqueName: \"kubernetes.io/projected/a90ebb69-b86a-4788-be37-191efdfea2a5-kube-api-access-wmfnm\") pod \"a90ebb69-b86a-4788-be37-191efdfea2a5\" (UID: \"a90ebb69-b86a-4788-be37-191efdfea2a5\") " Jul 29 00:58:45.301066 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.301043 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90ebb69-b86a-4788-be37-191efdfea2a5-kube-api-access-wmfnm" (OuterVolumeSpecName: "kube-api-access-wmfnm") pod "a90ebb69-b86a-4788-be37-191efdfea2a5" (UID: "a90ebb69-b86a-4788-be37-191efdfea2a5"). InnerVolumeSpecName "kube-api-access-wmfnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:58:45.373014 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.372949 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7666-140519451923888"] Jul 29 00:58:45.373356 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.373343 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90ebb69-b86a-4788-be37-191efdfea2a5" containerName="test-curl-7666-140519451925296" Jul 29 00:58:45.373407 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.373357 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90ebb69-b86a-4788-be37-191efdfea2a5" containerName="test-curl-7666-140519451925296" Jul 29 00:58:45.373452 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.373443 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90ebb69-b86a-4788-be37-191efdfea2a5" containerName="test-curl-7666-140519451925296" Jul 29 00:58:45.376477 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.376460 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:45.381295 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.381270 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451923888"] Jul 29 00:58:45.400253 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.400230 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmfnm\" (UniqueName: \"kubernetes.io/projected/a90ebb69-b86a-4788-be37-191efdfea2a5-kube-api-access-wmfnm\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:58:45.500880 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.500851 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7nk9\" (UniqueName: \"kubernetes.io/projected/2f13ba2b-c61e-48bc-93b6-9ca86039b26f-kube-api-access-b7nk9\") pod \"test-curl-7666-140519451923888\" (UID: \"2f13ba2b-c61e-48bc-93b6-9ca86039b26f\") " pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:45.601922 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.601891 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7nk9\" (UniqueName: \"kubernetes.io/projected/2f13ba2b-c61e-48bc-93b6-9ca86039b26f-kube-api-access-b7nk9\") pod \"test-curl-7666-140519451923888\" (UID: \"2f13ba2b-c61e-48bc-93b6-9ca86039b26f\") " pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:45.609500 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.609480 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7nk9\" (UniqueName: \"kubernetes.io/projected/2f13ba2b-c61e-48bc-93b6-9ca86039b26f-kube-api-access-b7nk9\") pod \"test-curl-7666-140519451923888\" (UID: \"2f13ba2b-c61e-48bc-93b6-9ca86039b26f\") " pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:45.686670 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.686639 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:45.819974 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:45.819948 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451923888"] Jul 29 00:58:45.821399 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:58:45.821375 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f13ba2b_c61e_48bc_93b6_9ca86039b26f.slice/crio-60696e8c594aee009eb7a8acbb58af51cc1e3d34da7ab30f790df0ae02398f6f WatchSource:0}: Error finding container 60696e8c594aee009eb7a8acbb58af51cc1e3d34da7ab30f790df0ae02398f6f: Status 404 returned error can't find the container with id 60696e8c594aee009eb7a8acbb58af51cc1e3d34da7ab30f790df0ae02398f6f Jul 29 00:58:46.067802 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:46.067717 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:46.067802 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:46.067727 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8022e5f6e5873ab25b2b7aec3c4316d74b34d5e90a6f2d782e328176353830b1" Jul 29 00:58:46.068905 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:46.068865 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451923888" event={"ID":"2f13ba2b-c61e-48bc-93b6-9ca86039b26f","Type":"ContainerStarted","Data":"60696e8c594aee009eb7a8acbb58af51cc1e3d34da7ab30f790df0ae02398f6f"} Jul 29 00:58:46.079484 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:58:46.079452 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7666-140519451925296\" is forbidden: User \"system:node:ip-10-0-133-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-130.ec2.internal' and this object" podUID="a90ebb69-b86a-4788-be37-191efdfea2a5" pod="opendatahub/test-curl-7666-140519451925296" Jul 29 00:58:46.116727 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:46.116701 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90ebb69-b86a-4788-be37-191efdfea2a5" path="/var/lib/kubelet/pods/a90ebb69-b86a-4788-be37-191efdfea2a5/volumes" Jul 29 00:58:47.076644 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:47.076611 2550 generic.go:356] "Generic (PLEG): container finished" podID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" containerID="a93456e5b0a4c4479313d0eabdbf26db2ab10cf390fdda1d9a4fa88d623003b1" exitCode=0 Jul 29 00:58:47.076644 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:47.076646 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451923888" event={"ID":"2f13ba2b-c61e-48bc-93b6-9ca86039b26f","Type":"ContainerDied","Data":"a93456e5b0a4c4479313d0eabdbf26db2ab10cf390fdda1d9a4fa88d623003b1"} Jul 29 00:58:48.221865 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.221840 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:48.243231 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.243194 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7666-140519451923888_2f13ba2b-c61e-48bc-93b6-9ca86039b26f/test-curl-7666-140519451923888/0.log" Jul 29 00:58:48.268319 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.268295 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7666-140519451923888"] Jul 29 00:58:48.270465 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.270446 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7666-140519451923888"] Jul 29 00:58:48.328780 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.328750 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7nk9\" (UniqueName: \"kubernetes.io/projected/2f13ba2b-c61e-48bc-93b6-9ca86039b26f-kube-api-access-b7nk9\") pod \"2f13ba2b-c61e-48bc-93b6-9ca86039b26f\" (UID: \"2f13ba2b-c61e-48bc-93b6-9ca86039b26f\") " Jul 29 00:58:48.330753 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.330721 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f13ba2b-c61e-48bc-93b6-9ca86039b26f-kube-api-access-b7nk9" (OuterVolumeSpecName: "kube-api-access-b7nk9") pod "2f13ba2b-c61e-48bc-93b6-9ca86039b26f" (UID: "2f13ba2b-c61e-48bc-93b6-9ca86039b26f"). InnerVolumeSpecName "kube-api-access-b7nk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:58:48.429797 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.429760 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7nk9\" (UniqueName: \"kubernetes.io/projected/2f13ba2b-c61e-48bc-93b6-9ca86039b26f-kube-api-access-b7nk9\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:58:48.441621 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.441589 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:48.441984 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.441971 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" containerName="test-curl-7666-140519451923888" Jul 29 00:58:48.442026 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.441988 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" containerName="test-curl-7666-140519451923888" Jul 29 00:58:48.442075 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.442065 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" containerName="test-curl-7666-140519451923888" Jul 29 00:58:48.445059 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.445044 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:48.451945 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.451918 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:48.631289 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.631262 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztv8\" (UniqueName: \"kubernetes.io/projected/b067df1c-2368-4294-9cb7-7099d14a5d3c-kube-api-access-bztv8\") pod \"test-curl-7666-140519451854864\" (UID: \"b067df1c-2368-4294-9cb7-7099d14a5d3c\") " pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:48.732768 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.732728 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztv8\" (UniqueName: \"kubernetes.io/projected/b067df1c-2368-4294-9cb7-7099d14a5d3c-kube-api-access-bztv8\") pod \"test-curl-7666-140519451854864\" (UID: \"b067df1c-2368-4294-9cb7-7099d14a5d3c\") " pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:48.740444 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.740418 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztv8\" (UniqueName: \"kubernetes.io/projected/b067df1c-2368-4294-9cb7-7099d14a5d3c-kube-api-access-bztv8\") pod \"test-curl-7666-140519451854864\" (UID: \"b067df1c-2368-4294-9cb7-7099d14a5d3c\") " pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:48.759251 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.759226 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:48.894364 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:48.894336 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:48.896028 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:58:48.896004 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb067df1c_2368_4294_9cb7_7099d14a5d3c.slice/crio-46885136ac1d71e938aaf30800002ad98f0c474a7c44a20b5c1d58b29f00238f WatchSource:0}: Error finding container 46885136ac1d71e938aaf30800002ad98f0c474a7c44a20b5c1d58b29f00238f: Status 404 returned error can't find the container with id 46885136ac1d71e938aaf30800002ad98f0c474a7c44a20b5c1d58b29f00238f Jul 29 00:58:49.089207 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:49.089175 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:49.089207 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:49.089202 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60696e8c594aee009eb7a8acbb58af51cc1e3d34da7ab30f790df0ae02398f6f" Jul 29 00:58:49.090509 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:49.090483 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451854864" event={"ID":"b067df1c-2368-4294-9cb7-7099d14a5d3c","Type":"ContainerStarted","Data":"46885136ac1d71e938aaf30800002ad98f0c474a7c44a20b5c1d58b29f00238f"} Jul 29 00:58:49.100025 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:58:49.099996 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7666-140519451923888\" is forbidden: User \"system:node:ip-10-0-133-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-130.ec2.internal' and this object" podUID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:50.097416 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:50.097386 2550 generic.go:356] "Generic (PLEG): container finished" podID="b067df1c-2368-4294-9cb7-7099d14a5d3c" containerID="569ee80859bd4e9e0b509a3f4ef84c5c817c7958ecdd399ea83b74400a3a83c2" exitCode=0 Jul 29 00:58:50.097845 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:50.097485 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451854864" event={"ID":"b067df1c-2368-4294-9cb7-7099d14a5d3c","Type":"ContainerDied","Data":"569ee80859bd4e9e0b509a3f4ef84c5c817c7958ecdd399ea83b74400a3a83c2"} Jul 29 00:58:50.112249 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:58:50.112211 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7666-140519451923888\" is forbidden: User \"system:node:ip-10-0-133-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-130.ec2.internal' and this object" podUID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" pod="opendatahub/test-curl-7666-140519451923888" Jul 29 00:58:50.116490 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:50.116464 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f13ba2b-c61e-48bc-93b6-9ca86039b26f" path="/var/lib/kubelet/pods/2f13ba2b-c61e-48bc-93b6-9ca86039b26f/volumes" Jul 29 00:58:50.814965 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:50.814930 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:58:51.237178 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.237154 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:51.253716 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.253689 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bztv8\" (UniqueName: \"kubernetes.io/projected/b067df1c-2368-4294-9cb7-7099d14a5d3c-kube-api-access-bztv8\") pod \"b067df1c-2368-4294-9cb7-7099d14a5d3c\" (UID: \"b067df1c-2368-4294-9cb7-7099d14a5d3c\") " Jul 29 00:58:51.255896 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.255877 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7666-140519451854864_b067df1c-2368-4294-9cb7-7099d14a5d3c/test-curl-7666-140519451854864/0.log" Jul 29 00:58:51.256003 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.255898 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b067df1c-2368-4294-9cb7-7099d14a5d3c-kube-api-access-bztv8" (OuterVolumeSpecName: "kube-api-access-bztv8") pod "b067df1c-2368-4294-9cb7-7099d14a5d3c" (UID: "b067df1c-2368-4294-9cb7-7099d14a5d3c"). InnerVolumeSpecName "kube-api-access-bztv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:58:51.280257 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.280234 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:51.282311 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.282291 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:51.354817 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.354754 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bztv8\" (UniqueName: \"kubernetes.io/projected/b067df1c-2368-4294-9cb7-7099d14a5d3c-kube-api-access-bztv8\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:58:51.404953 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.404927 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:51.405330 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.405319 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b067df1c-2368-4294-9cb7-7099d14a5d3c" containerName="test-curl-7666-140519451854864" Jul 29 00:58:51.405376 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.405332 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b067df1c-2368-4294-9cb7-7099d14a5d3c" containerName="test-curl-7666-140519451854864" Jul 29 00:58:51.405411 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.405395 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b067df1c-2368-4294-9cb7-7099d14a5d3c" containerName="test-curl-7666-140519451854864" Jul 29 00:58:51.408383 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.408368 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:51.414377 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.414358 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:51.455400 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.455373 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgdw\" (UniqueName: \"kubernetes.io/projected/d6de8094-7c96-4c92-81bc-596716b0781e-kube-api-access-hdgdw\") pod \"test-curl-7666-140519451854864\" (UID: \"d6de8094-7c96-4c92-81bc-596716b0781e\") " pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:51.556816 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.556783 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgdw\" (UniqueName: \"kubernetes.io/projected/d6de8094-7c96-4c92-81bc-596716b0781e-kube-api-access-hdgdw\") pod \"test-curl-7666-140519451854864\" (UID: \"d6de8094-7c96-4c92-81bc-596716b0781e\") " pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:51.564874 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.564851 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgdw\" (UniqueName: \"kubernetes.io/projected/d6de8094-7c96-4c92-81bc-596716b0781e-kube-api-access-hdgdw\") pod \"test-curl-7666-140519451854864\" (UID: \"d6de8094-7c96-4c92-81bc-596716b0781e\") " pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:51.718646 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.718619 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:51.846523 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:51.846500 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:51.848176 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:58:51.848137 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6de8094_7c96_4c92_81bc_596716b0781e.slice/crio-6478a9fda5272f8cfa4792b3e17e6cdfea94ab253fa28459b96a01dd6a3ed526 WatchSource:0}: Error finding container 6478a9fda5272f8cfa4792b3e17e6cdfea94ab253fa28459b96a01dd6a3ed526: Status 404 returned error can't find the container with id 6478a9fda5272f8cfa4792b3e17e6cdfea94ab253fa28459b96a01dd6a3ed526 Jul 29 00:58:52.109310 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:52.109237 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:52.109310 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:52.109272 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46885136ac1d71e938aaf30800002ad98f0c474a7c44a20b5c1d58b29f00238f" Jul 29 00:58:52.116294 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:52.116269 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b067df1c-2368-4294-9cb7-7099d14a5d3c" path="/var/lib/kubelet/pods/b067df1c-2368-4294-9cb7-7099d14a5d3c/volumes" Jul 29 00:58:52.116680 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:52.116659 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451854864" event={"ID":"d6de8094-7c96-4c92-81bc-596716b0781e","Type":"ContainerStarted","Data":"6478a9fda5272f8cfa4792b3e17e6cdfea94ab253fa28459b96a01dd6a3ed526"} Jul 29 00:58:53.117203 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:53.117169 2550 generic.go:356] "Generic (PLEG): container finished" podID="d6de8094-7c96-4c92-81bc-596716b0781e" containerID="debe083c2c38e3be719bbcae66bd40cc685f67d414d5ae2f1b7df17bc6c1cd4c" exitCode=0 Jul 29 00:58:53.117629 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:53.117261 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451854864" event={"ID":"d6de8094-7c96-4c92-81bc-596716b0781e","Type":"ContainerDied","Data":"debe083c2c38e3be719bbcae66bd40cc685f67d414d5ae2f1b7df17bc6c1cd4c"} Jul 29 00:58:54.263216 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.263190 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:54.279757 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.279730 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdgdw\" (UniqueName: \"kubernetes.io/projected/d6de8094-7c96-4c92-81bc-596716b0781e-kube-api-access-hdgdw\") pod \"d6de8094-7c96-4c92-81bc-596716b0781e\" (UID: \"d6de8094-7c96-4c92-81bc-596716b0781e\") " Jul 29 00:58:54.281838 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.281814 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7666-140519451854864_d6de8094-7c96-4c92-81bc-596716b0781e/test-curl-7666-140519451854864/0.log" Jul 29 00:58:54.281959 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.281941 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6de8094-7c96-4c92-81bc-596716b0781e-kube-api-access-hdgdw" (OuterVolumeSpecName: "kube-api-access-hdgdw") pod "d6de8094-7c96-4c92-81bc-596716b0781e" (UID: "d6de8094-7c96-4c92-81bc-596716b0781e"). InnerVolumeSpecName "kube-api-access-hdgdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:58:54.303122 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.303088 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:54.308067 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.308044 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7666-140519451854864"] Jul 29 00:58:54.380608 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.380574 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdgdw\" (UniqueName: \"kubernetes.io/projected/d6de8094-7c96-4c92-81bc-596716b0781e-kube-api-access-hdgdw\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:58:54.443070 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.443042 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7666-140519451855872"] Jul 29 00:58:54.443477 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.443464 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6de8094-7c96-4c92-81bc-596716b0781e" containerName="test-curl-7666-140519451854864" Jul 29 00:58:54.443524 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.443479 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6de8094-7c96-4c92-81bc-596716b0781e" containerName="test-curl-7666-140519451854864" Jul 29 00:58:54.443575 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.443560 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6de8094-7c96-4c92-81bc-596716b0781e" containerName="test-curl-7666-140519451854864" Jul 29 00:58:54.446475 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.446461 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:54.459787 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.459762 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"] Jul 29 00:58:54.482024 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.482001 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxwv4\" (UniqueName: \"kubernetes.io/projected/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064-kube-api-access-bxwv4\") pod \"test-curl-7666-140519451855872\" (UID: \"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064\") " pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:54.583448 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.583418 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxwv4\" (UniqueName: \"kubernetes.io/projected/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064-kube-api-access-bxwv4\") pod \"test-curl-7666-140519451855872\" (UID: \"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064\") " pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:54.591157 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.591127 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxwv4\" (UniqueName: \"kubernetes.io/projected/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064-kube-api-access-bxwv4\") pod \"test-curl-7666-140519451855872\" (UID: \"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064\") " pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:54.755741 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.755665 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:54.884931 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:54.884907 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"] Jul 29 00:58:54.886610 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:58:54.886580 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0c69ebb_cf36_4067_b4b3_0b2ba4e86064.slice/crio-572952caccf8828e29b68c047d88367521fababca4d38975f3154ed92a458c26 WatchSource:0}: Error finding container 572952caccf8828e29b68c047d88367521fababca4d38975f3154ed92a458c26: Status 404 returned error can't find the container with id 572952caccf8828e29b68c047d88367521fababca4d38975f3154ed92a458c26 Jul 29 00:58:55.128330 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:55.128244 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:55.128330 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:55.128262 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6478a9fda5272f8cfa4792b3e17e6cdfea94ab253fa28459b96a01dd6a3ed526" Jul 29 00:58:55.129377 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:55.129352 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451855872" event={"ID":"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064","Type":"ContainerStarted","Data":"572952caccf8828e29b68c047d88367521fababca4d38975f3154ed92a458c26"} Jul 29 00:58:55.139140 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:58:55.139114 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7666-140519451854864\" is forbidden: User \"system:node:ip-10-0-133-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-130.ec2.internal' and this object" podUID="d6de8094-7c96-4c92-81bc-596716b0781e" pod="opendatahub/test-curl-7666-140519451854864" Jul 29 00:58:56.117061 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:56.117032 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6de8094-7c96-4c92-81bc-596716b0781e" path="/var/lib/kubelet/pods/d6de8094-7c96-4c92-81bc-596716b0781e/volumes" Jul 29 00:58:56.135951 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:56.135919 2550 generic.go:356] "Generic (PLEG): container finished" podID="e0c69ebb-cf36-4067-b4b3-0b2ba4e86064" containerID="b762ddec32b0b59b23cfe9ac46de0febebcdd2d6d9759f9213ce4caf02aae710" exitCode=0 Jul 29 00:58:56.136095 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:56.135979 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451855872" event={"ID":"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064","Type":"ContainerDied","Data":"b762ddec32b0b59b23cfe9ac46de0febebcdd2d6d9759f9213ce4caf02aae710"} Jul 29 00:58:57.273611 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.273583 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:57.292515 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.292484 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7666-140519451855872_e0c69ebb-cf36-4067-b4b3-0b2ba4e86064/test-curl-7666-140519451855872/0.log" Jul 29 00:58:57.307831 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.307802 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxwv4\" (UniqueName: \"kubernetes.io/projected/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064-kube-api-access-bxwv4\") pod \"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064\" (UID: \"e0c69ebb-cf36-4067-b4b3-0b2ba4e86064\") " Jul 29 00:58:57.309834 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.309813 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064-kube-api-access-bxwv4" (OuterVolumeSpecName: "kube-api-access-bxwv4") pod "e0c69ebb-cf36-4067-b4b3-0b2ba4e86064" (UID: "e0c69ebb-cf36-4067-b4b3-0b2ba4e86064"). InnerVolumeSpecName "kube-api-access-bxwv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:58:57.316369 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.316347 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"] Jul 29 00:58:57.318508 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.318484 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"] Jul 29 00:58:57.409420 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:57.409362 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxwv4\" (UniqueName: \"kubernetes.io/projected/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064-kube-api-access-bxwv4\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:58:58.117111 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:58.117082 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c69ebb-cf36-4067-b4b3-0b2ba4e86064" path="/var/lib/kubelet/pods/e0c69ebb-cf36-4067-b4b3-0b2ba4e86064/volumes" Jul 29 00:58:58.147695 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:58.147668 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872" Jul 29 00:58:58.147838 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:58:58.147730 2550 scope.go:117] "RemoveContainer" containerID="b762ddec32b0b59b23cfe9ac46de0febebcdd2d6d9759f9213ce4caf02aae710" Jul 29 00:59:05.264641 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.264601 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2"] Jul 29 00:59:05.265083 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.265064 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c69ebb-cf36-4067-b4b3-0b2ba4e86064" containerName="test-curl-7666-140519451855872" Jul 29 00:59:05.265083 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.265084 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c69ebb-cf36-4067-b4b3-0b2ba4e86064" containerName="test-curl-7666-140519451855872" Jul 29 00:59:05.265237 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.265223 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c69ebb-cf36-4067-b4b3-0b2ba4e86064" containerName="test-curl-7666-140519451855872" Jul 29 00:59:05.267461 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.267446 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.269996 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.269976 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-63186d-dockercfg-xx2tb\"" Jul 29 00:59:05.270211 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.270191 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-63186d\"" Jul 29 00:59:05.276712 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.276690 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2"] Jul 29 00:59:05.301131 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.301109 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w"] Jul 29 00:59:05.304216 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.304200 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.315491 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.315461 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w"] Jul 29 00:59:05.381579 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.381531 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594de192-873f-4fa7-b3b1-625725de1303-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.381764 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.381584 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdd28e7-d326-4785-8f3c-824af5924687-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.381764 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.381710 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckhm7\" (UniqueName: \"kubernetes.io/projected/9fdd28e7-d326-4785-8f3c-824af5924687-kube-api-access-ckhm7\") pod \"payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.381880 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.381766 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkbh\" (UniqueName: \"kubernetes.io/projected/594de192-873f-4fa7-b3b1-625725de1303-kube-api-access-nvkbh\") pod \"payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.482805 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.482768 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckhm7\" (UniqueName: \"kubernetes.io/projected/9fdd28e7-d326-4785-8f3c-824af5924687-kube-api-access-ckhm7\") pod \"payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.482991 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.482815 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkbh\" (UniqueName: \"kubernetes.io/projected/594de192-873f-4fa7-b3b1-625725de1303-kube-api-access-nvkbh\") pod \"payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.482991 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.482873 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594de192-873f-4fa7-b3b1-625725de1303-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.482991 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.482893 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdd28e7-d326-4785-8f3c-824af5924687-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.483625 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.483602 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594de192-873f-4fa7-b3b1-625725de1303-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.483686 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.483641 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdd28e7-d326-4785-8f3c-824af5924687-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.490789 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.490763 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckhm7\" (UniqueName: \"kubernetes.io/projected/9fdd28e7-d326-4785-8f3c-824af5924687-kube-api-access-ckhm7\") pod \"payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.490874 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.490808 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkbh\" (UniqueName: \"kubernetes.io/projected/594de192-873f-4fa7-b3b1-625725de1303-kube-api-access-nvkbh\") pod \"payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.579859 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.579780 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:05.614540 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.614497 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:05.736381 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.736352 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2"] Jul 29 00:59:05.738773 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:59:05.738646 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594de192_873f_4fa7_b3b1_625725de1303.slice/crio-30712d2ec85589b051eeb61429c388aada67bb06ee9b026deca45d89c3a2d20f WatchSource:0}: Error finding container 30712d2ec85589b051eeb61429c388aada67bb06ee9b026deca45d89c3a2d20f: Status 404 returned error can't find the container with id 30712d2ec85589b051eeb61429c388aada67bb06ee9b026deca45d89c3a2d20f Jul 29 00:59:05.766127 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:05.766104 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w"] Jul 29 00:59:05.775820 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:59:05.775794 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdd28e7_d326_4785_8f3c_824af5924687.slice/crio-a5966b4e69e95938b740830c2afa0b99b31b8f9749a81ffac6fe009f46ecdde5 WatchSource:0}: Error finding container a5966b4e69e95938b740830c2afa0b99b31b8f9749a81ffac6fe009f46ecdde5: Status 404 returned error can't find the container with id a5966b4e69e95938b740830c2afa0b99b31b8f9749a81ffac6fe009f46ecdde5 Jul 29 00:59:06.201417 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.201382 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" event={"ID":"9fdd28e7-d326-4785-8f3c-824af5924687","Type":"ContainerStarted","Data":"9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636"} Jul 29 00:59:06.201620 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.201444 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" event={"ID":"9fdd28e7-d326-4785-8f3c-824af5924687","Type":"ContainerStarted","Data":"a5966b4e69e95938b740830c2afa0b99b31b8f9749a81ffac6fe009f46ecdde5"} Jul 29 00:59:06.201620 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.201472 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:06.202816 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.202771 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" event={"ID":"594de192-873f-4fa7-b3b1-625725de1303","Type":"ContainerStarted","Data":"d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced"} Jul 29 00:59:06.202923 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.202830 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:06.202923 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.202847 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" event={"ID":"594de192-873f-4fa7-b3b1-625725de1303","Type":"ContainerStarted","Data":"30712d2ec85589b051eeb61429c388aada67bb06ee9b026deca45d89c3a2d20f"} Jul 29 00:59:06.219631 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.219588 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" podStartSLOduration=1.219573233 podStartE2EDuration="1.219573233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:59:06.217573902 +0000 UTC m=+3042.736902575" watchObservedRunningTime="2026-07-29 00:59:06.219573233 +0000 UTC m=+3042.738901880" Jul 29 00:59:06.232345 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:06.232302 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" podStartSLOduration=1.232288318 podStartE2EDuration="1.232288318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:59:06.231124018 +0000 UTC m=+3042.750452665" watchObservedRunningTime="2026-07-29 00:59:06.232288318 +0000 UTC m=+3042.751616963" Jul 29 00:59:09.539767 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.539732 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rl9tw"] Jul 29 00:59:09.544644 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.544627 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:09.547273 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.547247 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fwdhj\"" Jul 29 00:59:09.550382 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.550359 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rl9tw"] Jul 29 00:59:09.617691 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.617662 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4cw\" (UniqueName: \"kubernetes.io/projected/8c2b7024-5875-4396-af21-e613e324c53f-kube-api-access-ph4cw\") pod \"kuadrant-operator-catalog-rl9tw\" (UID: \"8c2b7024-5875-4396-af21-e613e324c53f\") " pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:09.718498 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.718466 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4cw\" (UniqueName: \"kubernetes.io/projected/8c2b7024-5875-4396-af21-e613e324c53f-kube-api-access-ph4cw\") pod \"kuadrant-operator-catalog-rl9tw\" (UID: \"8c2b7024-5875-4396-af21-e613e324c53f\") " pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:09.726158 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.726133 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4cw\" (UniqueName: \"kubernetes.io/projected/8c2b7024-5875-4396-af21-e613e324c53f-kube-api-access-ph4cw\") pod \"kuadrant-operator-catalog-rl9tw\" (UID: \"8c2b7024-5875-4396-af21-e613e324c53f\") " pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:09.856369 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.856280 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:09.987030 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:09.987008 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rl9tw"] Jul 29 00:59:09.988722 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:59:09.988689 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2b7024_5875_4396_af21_e613e324c53f.slice/crio-d75277510163f8444bba9f23a18ec9b35a9e682b71c5c8969f42e01c05dee892 WatchSource:0}: Error finding container d75277510163f8444bba9f23a18ec9b35a9e682b71c5c8969f42e01c05dee892: Status 404 returned error can't find the container with id d75277510163f8444bba9f23a18ec9b35a9e682b71c5c8969f42e01c05dee892 Jul 29 00:59:10.226480 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:10.226442 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" event={"ID":"8c2b7024-5875-4396-af21-e613e324c53f","Type":"ContainerStarted","Data":"d75277510163f8444bba9f23a18ec9b35a9e682b71c5c8969f42e01c05dee892"} Jul 29 00:59:12.247482 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:12.247444 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" event={"ID":"8c2b7024-5875-4396-af21-e613e324c53f","Type":"ContainerStarted","Data":"a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e"} Jul 29 00:59:12.265131 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:12.265080 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" podStartSLOduration=1.121728255 podStartE2EDuration="3.265062845s" totalImagesPullingTime="2.14333459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:59:12.262578828 +0000 UTC m=+3048.781907495" watchObservedRunningTime="2026-07-29 00:59:12.265062845 +0000 UTC m=+3048.784391491" Jul 29 00:59:13.117354 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:13.117320 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:59:17.211763 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:17.211679 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 00:59:17.212173 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:17.211843 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 00:59:19.857211 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:19.857173 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:19.857723 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:19.857240 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:19.879060 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:19.879037 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:20.310610 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:20.310579 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:20.343021 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:20.342989 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rl9tw"] Jul 29 00:59:22.300017 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:22.299980 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" podUID="8c2b7024-5875-4396-af21-e613e324c53f" containerName="registry-server" containerID="cri-o://a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e" gracePeriod=2 Jul 29 00:59:22.550256 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:22.550204 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:22.642899 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:22.642868 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph4cw\" (UniqueName: \"kubernetes.io/projected/8c2b7024-5875-4396-af21-e613e324c53f-kube-api-access-ph4cw\") pod \"8c2b7024-5875-4396-af21-e613e324c53f\" (UID: \"8c2b7024-5875-4396-af21-e613e324c53f\") " Jul 29 00:59:22.644847 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:22.644822 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c2b7024-5875-4396-af21-e613e324c53f-kube-api-access-ph4cw" (OuterVolumeSpecName: "kube-api-access-ph4cw") pod "8c2b7024-5875-4396-af21-e613e324c53f" (UID: "8c2b7024-5875-4396-af21-e613e324c53f"). InnerVolumeSpecName "kube-api-access-ph4cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 00:59:22.744089 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:22.744054 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph4cw\" (UniqueName: \"kubernetes.io/projected/8c2b7024-5875-4396-af21-e613e324c53f-kube-api-access-ph4cw\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 00:59:23.306182 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.306148 2550 generic.go:356] "Generic (PLEG): container finished" podID="8c2b7024-5875-4396-af21-e613e324c53f" containerID="a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e" exitCode=0 Jul 29 00:59:23.306683 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.306193 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" Jul 29 00:59:23.306683 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.306232 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" event={"ID":"8c2b7024-5875-4396-af21-e613e324c53f","Type":"ContainerDied","Data":"a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e"} Jul 29 00:59:23.306683 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.306284 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rl9tw" event={"ID":"8c2b7024-5875-4396-af21-e613e324c53f","Type":"ContainerDied","Data":"d75277510163f8444bba9f23a18ec9b35a9e682b71c5c8969f42e01c05dee892"} Jul 29 00:59:23.306683 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.306304 2550 scope.go:117] "RemoveContainer" containerID="a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e" Jul 29 00:59:23.316384 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.316356 2550 scope.go:117] "RemoveContainer" containerID="a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e" Jul 29 00:59:23.316664 ip-10-0-133-130 kubenswrapper[2550]: E0729 00:59:23.316640 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e\": container with ID starting with a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e not found: ID does not exist" containerID="a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e" Jul 29 00:59:23.316738 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.316672 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e"} err="failed to get container status \"a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e\": rpc error: code = NotFound desc = could not find container \"a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e\": container with ID starting with a8fa6c0027719c3820add97e4d0b5d7fa15307c02c0e52936ba8ef5210ccc78e not found: ID does not exist" Jul 29 00:59:23.326507 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.326480 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rl9tw"] Jul 29 00:59:23.332387 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:23.332367 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rl9tw"] Jul 29 00:59:24.117877 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:24.117834 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c2b7024-5875-4396-af21-e613e324c53f" path="/var/lib/kubelet/pods/8c2b7024-5875-4396-af21-e613e324c53f/volumes" Jul 29 00:59:34.689145 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.689107 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7"] Jul 29 00:59:34.689629 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.689523 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2b7024-5875-4396-af21-e613e324c53f" containerName="registry-server" Jul 29 00:59:34.689629 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.689534 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2b7024-5875-4396-af21-e613e324c53f" containerName="registry-server" Jul 29 00:59:34.689629 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.689620 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2b7024-5875-4396-af21-e613e324c53f" containerName="registry-server" Jul 29 00:59:34.695353 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.695333 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:34.698058 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.698035 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-efa6ac\"" Jul 29 00:59:34.698188 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.698077 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-efa6ac-dockercfg-tq85l\"" Jul 29 00:59:34.703740 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.703716 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7"] Jul 29 00:59:34.711913 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.711886 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2"] Jul 29 00:59:34.715322 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.715302 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.727794 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.727775 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2"] Jul 29 00:59:34.750771 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.750741 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47f386fb-617f-40b4-852d-29ccd35f9488-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.750884 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.750807 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdbzd\" (UniqueName: \"kubernetes.io/projected/47f386fb-617f-40b4-852d-29ccd35f9488-kube-api-access-gdbzd\") pod \"payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.750884 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.750838 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7bb374-1396-44be-8bf0-e6fb35128653-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:34.750983 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.750962 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58nkk\" (UniqueName: \"kubernetes.io/projected/0c7bb374-1396-44be-8bf0-e6fb35128653-kube-api-access-58nkk\") pod \"payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:34.852009 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.851979 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nkk\" (UniqueName: \"kubernetes.io/projected/0c7bb374-1396-44be-8bf0-e6fb35128653-kube-api-access-58nkk\") pod \"payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:34.852151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.852034 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47f386fb-617f-40b4-852d-29ccd35f9488-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.852151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.852067 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdbzd\" (UniqueName: \"kubernetes.io/projected/47f386fb-617f-40b4-852d-29ccd35f9488-kube-api-access-gdbzd\") pod \"payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.852151 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.852082 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7bb374-1396-44be-8bf0-e6fb35128653-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:34.852782 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.852765 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47f386fb-617f-40b4-852d-29ccd35f9488-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.852878 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.852862 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7bb374-1396-44be-8bf0-e6fb35128653-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:34.860050 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.860030 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdbzd\" (UniqueName: \"kubernetes.io/projected/47f386fb-617f-40b4-852d-29ccd35f9488-kube-api-access-gdbzd\") pod \"payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:34.860050 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:34.860040 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nkk\" (UniqueName: \"kubernetes.io/projected/0c7bb374-1396-44be-8bf0-e6fb35128653-kube-api-access-58nkk\") pod \"payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:35.007774 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.007694 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:35.024993 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.024967 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:35.156122 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.156070 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7"] Jul 29 00:59:35.156271 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:59:35.156152 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7bb374_1396_44be_8bf0_e6fb35128653.slice/crio-2a61958d874f073b3fabb2d2dfd570c9cd2f68f1a702b611efc01026a78dadeb WatchSource:0}: Error finding container 2a61958d874f073b3fabb2d2dfd570c9cd2f68f1a702b611efc01026a78dadeb: Status 404 returned error can't find the container with id 2a61958d874f073b3fabb2d2dfd570c9cd2f68f1a702b611efc01026a78dadeb Jul 29 00:59:35.184837 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.184812 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2"] Jul 29 00:59:35.189132 ip-10-0-133-130 kubenswrapper[2550]: W0729 00:59:35.189095 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f386fb_617f_40b4_852d_29ccd35f9488.slice/crio-23c6cb8a220114d2e6719985d5a502c775cdd5a41b4a08486859852f73da4553 WatchSource:0}: Error finding container 23c6cb8a220114d2e6719985d5a502c775cdd5a41b4a08486859852f73da4553: Status 404 returned error can't find the container with id 23c6cb8a220114d2e6719985d5a502c775cdd5a41b4a08486859852f73da4553 Jul 29 00:59:35.377711 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.377605 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" event={"ID":"47f386fb-617f-40b4-852d-29ccd35f9488","Type":"ContainerStarted","Data":"d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d"} Jul 29 00:59:35.377711 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.377679 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:35.377711 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.377706 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" event={"ID":"47f386fb-617f-40b4-852d-29ccd35f9488","Type":"ContainerStarted","Data":"23c6cb8a220114d2e6719985d5a502c775cdd5a41b4a08486859852f73da4553"} Jul 29 00:59:35.379360 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.379336 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" event={"ID":"0c7bb374-1396-44be-8bf0-e6fb35128653","Type":"ContainerStarted","Data":"5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326"} Jul 29 00:59:35.379499 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.379382 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" event={"ID":"0c7bb374-1396-44be-8bf0-e6fb35128653","Type":"ContainerStarted","Data":"2a61958d874f073b3fabb2d2dfd570c9cd2f68f1a702b611efc01026a78dadeb"} Jul 29 00:59:35.379499 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.379432 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 00:59:35.394855 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.394799 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" podStartSLOduration=1.394781563 podStartE2EDuration="1.394781563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:59:35.391851197 +0000 UTC m=+3071.911179844" watchObservedRunningTime="2026-07-29 00:59:35.394781563 +0000 UTC m=+3071.914110216" Jul 29 00:59:35.409252 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:35.409204 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" podStartSLOduration=1.4091853730000001 podStartE2EDuration="1.409185373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:59:35.407476436 +0000 UTC m=+3071.926805085" watchObservedRunningTime="2026-07-29 00:59:35.409185373 +0000 UTC m=+3071.928514023" Jul 29 00:59:43.108094 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:43.108050 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 00:59:46.388612 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:46.388573 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 00:59:46.389005 ip-10-0-133-130 kubenswrapper[2550]: I0729 00:59:46.388885 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 01:00:05.992625 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:05.992593 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2_47f386fb-617f-40b4-852d-29ccd35f9488/payload-processing/0.log" Jul 29 01:00:16.005690 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:16.005655 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:00:41.218391 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:41.218356 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:00:52.909217 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:52.909146 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w_9fdd28e7-d326-4785-8f3c-824af5924687/payload-processing/0.log" Jul 29 01:00:53.158444 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:53.158416 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2_47f386fb-617f-40b4-852d-29ccd35f9488/payload-processing/0.log" Jul 29 01:00:57.910203 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.910171 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4"] Jul 29 01:00:57.914724 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.914691 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:57.922113 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.922089 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-91da6f\"" Jul 29 01:00:57.922244 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.922151 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-91da6f-dockercfg-lw2dx\"" Jul 29 01:00:57.928689 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.928660 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4"] Jul 29 01:00:57.953117 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.953089 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6"] Jul 29 01:00:57.956006 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.955986 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:57.966777 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:57.966753 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6"] Jul 29 01:00:58.022077 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.022048 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.022204 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.022097 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mqg\" (UniqueName: \"kubernetes.io/projected/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-kube-api-access-t8mqg\") pod \"payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.123446 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.123406 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2a0b6-3233-426a-8465-6dc41461c8d3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.123663 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.123470 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.123663 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.123536 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mqg\" (UniqueName: \"kubernetes.io/projected/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-kube-api-access-t8mqg\") pod \"payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.123663 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.123587 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpr29\" (UniqueName: \"kubernetes.io/projected/6ea2a0b6-3233-426a-8465-6dc41461c8d3-kube-api-access-dpr29\") pod \"payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.124087 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.124068 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.133172 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.133155 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mqg\" (UniqueName: \"kubernetes.io/projected/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-kube-api-access-t8mqg\") pod \"payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.224364 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.224286 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpr29\" (UniqueName: \"kubernetes.io/projected/6ea2a0b6-3233-426a-8465-6dc41461c8d3-kube-api-access-dpr29\") pod \"payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.224521 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.224489 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2a0b6-3233-426a-8465-6dc41461c8d3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.225203 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.225181 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2a0b6-3233-426a-8465-6dc41461c8d3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.228210 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.228193 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.232286 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.232264 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpr29\" (UniqueName: \"kubernetes.io/projected/6ea2a0b6-3233-426a-8465-6dc41461c8d3-kube-api-access-dpr29\") pod \"payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.268213 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.268177 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.383227 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.383199 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4"] Jul 29 01:00:58.385381 ip-10-0-133-130 kubenswrapper[2550]: W0729 01:00:58.385355 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42e2c68_65b0_40aa_bcf2_5ba4240645d6.slice/crio-c4c4703ba6433d162d27d3e10408e654717442850c8d1b8b12ca4b0fa19b66b9 WatchSource:0}: Error finding container c4c4703ba6433d162d27d3e10408e654717442850c8d1b8b12ca4b0fa19b66b9: Status 404 returned error can't find the container with id c4c4703ba6433d162d27d3e10408e654717442850c8d1b8b12ca4b0fa19b66b9 Jul 29 01:00:58.419642 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.419615 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6"] Jul 29 01:00:58.422642 ip-10-0-133-130 kubenswrapper[2550]: W0729 01:00:58.422617 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea2a0b6_3233_426a_8465_6dc41461c8d3.slice/crio-c822abc2dd87087ddc0b266f602d271e5233362deeb35757ca31ee6309e60c2a WatchSource:0}: Error finding container c822abc2dd87087ddc0b266f602d271e5233362deeb35757ca31ee6309e60c2a: Status 404 returned error can't find the container with id c822abc2dd87087ddc0b266f602d271e5233362deeb35757ca31ee6309e60c2a Jul 29 01:00:58.863133 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.863050 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" event={"ID":"c42e2c68-65b0-40aa-bcf2-5ba4240645d6","Type":"ContainerStarted","Data":"5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a"} Jul 29 01:00:58.863133 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.863101 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" event={"ID":"c42e2c68-65b0-40aa-bcf2-5ba4240645d6","Type":"ContainerStarted","Data":"c4c4703ba6433d162d27d3e10408e654717442850c8d1b8b12ca4b0fa19b66b9"} Jul 29 01:00:58.863361 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.863152 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:00:58.864696 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.864670 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" event={"ID":"6ea2a0b6-3233-426a-8465-6dc41461c8d3","Type":"ContainerStarted","Data":"6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a"} Jul 29 01:00:58.864819 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.864707 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" event={"ID":"6ea2a0b6-3233-426a-8465-6dc41461c8d3","Type":"ContainerStarted","Data":"c822abc2dd87087ddc0b266f602d271e5233362deeb35757ca31ee6309e60c2a"} Jul 29 01:00:58.864819 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.864738 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:00:58.879664 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.879613 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" podStartSLOduration=1.8795996590000001 podStartE2EDuration="1.879599659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:00:58.87738241 +0000 UTC m=+3155.396711080" watchObservedRunningTime="2026-07-29 01:00:58.879599659 +0000 UTC m=+3155.398928365" Jul 29 01:00:58.892865 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:00:58.892825 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" podStartSLOduration=1.8928139910000001 podStartE2EDuration="1.892813991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:00:58.891131955 +0000 UTC m=+3155.410460629" watchObservedRunningTime="2026-07-29 01:00:58.892813991 +0000 UTC m=+3155.412142637" Jul 29 01:01:00.816413 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:00.816384 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:01:09.872280 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:09.872249 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:01:09.872782 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:09.872413 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:01:28.075084 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.075049 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6"] Jul 29 01:01:28.075658 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.075300 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" podUID="6ea2a0b6-3233-426a-8465-6dc41461c8d3" containerName="payload-processing" containerID="cri-o://6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a" gracePeriod=30 Jul 29 01:01:28.081223 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.081193 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4"] Jul 29 01:01:28.081475 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.081425 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" podUID="c42e2c68-65b0-40aa-bcf2-5ba4240645d6" containerName="payload-pre-processing" containerID="cri-o://5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a" gracePeriod=30 Jul 29 01:01:28.357089 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.357068 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:01:28.360331 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.360306 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:01:28.495725 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.495691 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-plugins-config-volume\") pod \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " Jul 29 01:01:28.495897 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.495883 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2a0b6-3233-426a-8465-6dc41461c8d3-plugins-config-volume\") pod \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " Jul 29 01:01:28.495954 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.495930 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpr29\" (UniqueName: \"kubernetes.io/projected/6ea2a0b6-3233-426a-8465-6dc41461c8d3-kube-api-access-dpr29\") pod \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\" (UID: \"6ea2a0b6-3233-426a-8465-6dc41461c8d3\") " Jul 29 01:01:28.496031 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.496015 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8mqg\" (UniqueName: \"kubernetes.io/projected/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-kube-api-access-t8mqg\") pod \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\" (UID: \"c42e2c68-65b0-40aa-bcf2-5ba4240645d6\") " Jul 29 01:01:28.496203 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.496183 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c42e2c68-65b0-40aa-bcf2-5ba4240645d6" (UID: "c42e2c68-65b0-40aa-bcf2-5ba4240645d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:01:28.496254 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.496236 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea2a0b6-3233-426a-8465-6dc41461c8d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ea2a0b6-3233-426a-8465-6dc41461c8d3" (UID: "6ea2a0b6-3233-426a-8465-6dc41461c8d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:01:28.496350 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.496332 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2a0b6-3233-426a-8465-6dc41461c8d3-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:28.496410 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.496350 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:28.498039 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.498016 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea2a0b6-3233-426a-8465-6dc41461c8d3-kube-api-access-dpr29" (OuterVolumeSpecName: "kube-api-access-dpr29") pod "6ea2a0b6-3233-426a-8465-6dc41461c8d3" (UID: "6ea2a0b6-3233-426a-8465-6dc41461c8d3"). InnerVolumeSpecName "kube-api-access-dpr29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:01:28.498196 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.498127 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-kube-api-access-t8mqg" (OuterVolumeSpecName: "kube-api-access-t8mqg") pod "c42e2c68-65b0-40aa-bcf2-5ba4240645d6" (UID: "c42e2c68-65b0-40aa-bcf2-5ba4240645d6"). InnerVolumeSpecName "kube-api-access-t8mqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:01:28.597978 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.597908 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8mqg\" (UniqueName: \"kubernetes.io/projected/c42e2c68-65b0-40aa-bcf2-5ba4240645d6-kube-api-access-t8mqg\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:28.597978 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:28.597937 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpr29\" (UniqueName: \"kubernetes.io/projected/6ea2a0b6-3233-426a-8465-6dc41461c8d3-kube-api-access-dpr29\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:29.040050 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.040017 2550 generic.go:356] "Generic (PLEG): container finished" podID="c42e2c68-65b0-40aa-bcf2-5ba4240645d6" containerID="5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a" exitCode=0 Jul 29 01:01:29.040248 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.040084 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" Jul 29 01:01:29.040248 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.040110 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" event={"ID":"c42e2c68-65b0-40aa-bcf2-5ba4240645d6","Type":"ContainerDied","Data":"5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a"} Jul 29 01:01:29.040248 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.040176 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4" event={"ID":"c42e2c68-65b0-40aa-bcf2-5ba4240645d6","Type":"ContainerDied","Data":"c4c4703ba6433d162d27d3e10408e654717442850c8d1b8b12ca4b0fa19b66b9"} Jul 29 01:01:29.040248 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.040207 2550 scope.go:117] "RemoveContainer" containerID="5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a" Jul 29 01:01:29.041542 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.041519 2550 generic.go:356] "Generic (PLEG): container finished" podID="6ea2a0b6-3233-426a-8465-6dc41461c8d3" containerID="6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a" exitCode=0 Jul 29 01:01:29.041670 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.041585 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" Jul 29 01:01:29.041670 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.041587 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" event={"ID":"6ea2a0b6-3233-426a-8465-6dc41461c8d3","Type":"ContainerDied","Data":"6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a"} Jul 29 01:01:29.041670 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.041640 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6" event={"ID":"6ea2a0b6-3233-426a-8465-6dc41461c8d3","Type":"ContainerDied","Data":"c822abc2dd87087ddc0b266f602d271e5233362deeb35757ca31ee6309e60c2a"} Jul 29 01:01:29.049716 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.049538 2550 scope.go:117] "RemoveContainer" containerID="5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a" Jul 29 01:01:29.049873 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:01:29.049840 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a\": container with ID starting with 5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a not found: ID does not exist" containerID="5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a" Jul 29 01:01:29.049942 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.049874 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a"} err="failed to get container status \"5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a\": rpc error: code = NotFound desc = could not find container \"5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a\": container with ID starting with 5ce59155ff3ad532836766afd78054a4ba7ab4ceed7951b1bcba63b16ace320a not found: ID does not exist" Jul 29 01:01:29.049942 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.049898 2550 scope.go:117] "RemoveContainer" containerID="6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a" Jul 29 01:01:29.058539 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.058522 2550 scope.go:117] "RemoveContainer" containerID="6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a" Jul 29 01:01:29.058876 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:01:29.058858 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a\": container with ID starting with 6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a not found: ID does not exist" containerID="6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a" Jul 29 01:01:29.058929 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.058883 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a"} err="failed to get container status \"6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a\": rpc error: code = NotFound desc = could not find container \"6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a\": container with ID starting with 6a9cd2d6a991f493e211f34f2b4086883f448ab1c1258e7a15f555fced2abb9a not found: ID does not exist" Jul 29 01:01:29.065165 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.065143 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4"] Jul 29 01:01:29.070371 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.070352 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-91da6f-6b564cc4cb-jzxr4"] Jul 29 01:01:29.080326 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.080294 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6"] Jul 29 01:01:29.088352 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:29.088332 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-91da6f-6cbfbb6ccd-xvjh6"] Jul 29 01:01:30.116490 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:30.116451 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea2a0b6-3233-426a-8465-6dc41461c8d3" path="/var/lib/kubelet/pods/6ea2a0b6-3233-426a-8465-6dc41461c8d3/volumes" Jul 29 01:01:30.117004 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:30.116971 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c42e2c68-65b0-40aa-bcf2-5ba4240645d6" path="/var/lib/kubelet/pods/c42e2c68-65b0-40aa-bcf2-5ba4240645d6/volumes" Jul 29 01:01:32.913484 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:32.913443 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:01:38.347244 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347209 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd"] Jul 29 01:01:38.347727 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347648 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea2a0b6-3233-426a-8465-6dc41461c8d3" containerName="payload-processing" Jul 29 01:01:38.347727 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347660 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea2a0b6-3233-426a-8465-6dc41461c8d3" containerName="payload-processing" Jul 29 01:01:38.347727 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347670 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42e2c68-65b0-40aa-bcf2-5ba4240645d6" containerName="payload-pre-processing" Jul 29 01:01:38.347727 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347677 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42e2c68-65b0-40aa-bcf2-5ba4240645d6" containerName="payload-pre-processing" Jul 29 01:01:38.347866 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347737 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea2a0b6-3233-426a-8465-6dc41461c8d3" containerName="payload-processing" Jul 29 01:01:38.347866 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.347746 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c42e2c68-65b0-40aa-bcf2-5ba4240645d6" containerName="payload-pre-processing" Jul 29 01:01:38.350683 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.350667 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:38.352982 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.352959 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 01:01:38.354275 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.354254 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\"" Jul 29 01:01:38.357357 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.357333 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd"] Jul 29 01:01:38.489748 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.489715 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e958bcd2-caf5-4df4-bcdd-0db58c82d37f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd\" (UID: \"e958bcd2-caf5-4df4-bcdd-0db58c82d37f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:38.590898 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.590865 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e958bcd2-caf5-4df4-bcdd-0db58c82d37f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd\" (UID: \"e958bcd2-caf5-4df4-bcdd-0db58c82d37f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:38.591519 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.591498 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e958bcd2-caf5-4df4-bcdd-0db58c82d37f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd\" (UID: \"e958bcd2-caf5-4df4-bcdd-0db58c82d37f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:38.664844 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.664820 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:38.799265 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:38.799235 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd"] Jul 29 01:01:38.801357 ip-10-0-133-130 kubenswrapper[2550]: W0729 01:01:38.801326 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode958bcd2_caf5_4df4_bcdd_0db58c82d37f.slice/crio-44443c77c4f93847dc8c506a5a445e03ab8856b3bb397ca7cbb14a98cda98f95 WatchSource:0}: Error finding container 44443c77c4f93847dc8c506a5a445e03ab8856b3bb397ca7cbb14a98cda98f95: Status 404 returned error can't find the container with id 44443c77c4f93847dc8c506a5a445e03ab8856b3bb397ca7cbb14a98cda98f95 Jul 29 01:01:39.101664 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:39.101626 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" event={"ID":"e958bcd2-caf5-4df4-bcdd-0db58c82d37f","Type":"ContainerStarted","Data":"9359b5971010659f76bc7360bdfb11114fbd74b04e4878d65526698d25240d00"} Jul 29 01:01:39.101810 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:39.101686 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" event={"ID":"e958bcd2-caf5-4df4-bcdd-0db58c82d37f","Type":"ContainerStarted","Data":"44443c77c4f93847dc8c506a5a445e03ab8856b3bb397ca7cbb14a98cda98f95"} Jul 29 01:01:39.118688 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:39.118647 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" podStartSLOduration=1.11863244 podStartE2EDuration="1.11863244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:01:39.117595727 +0000 UTC m=+3195.636924394" watchObservedRunningTime="2026-07-29 01:01:39.11863244 +0000 UTC m=+3195.637961131" Jul 29 01:01:40.108385 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:40.108351 2550 generic.go:356] "Generic (PLEG): container finished" podID="e958bcd2-caf5-4df4-bcdd-0db58c82d37f" containerID="9359b5971010659f76bc7360bdfb11114fbd74b04e4878d65526698d25240d00" exitCode=0 Jul 29 01:01:40.108784 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:40.108436 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" event={"ID":"e958bcd2-caf5-4df4-bcdd-0db58c82d37f","Type":"ContainerDied","Data":"9359b5971010659f76bc7360bdfb11114fbd74b04e4878d65526698d25240d00"} Jul 29 01:01:41.250271 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:41.250244 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:41.419048 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:41.419024 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e958bcd2-caf5-4df4-bcdd-0db58c82d37f-maas-api-service-ca\") pod \"e958bcd2-caf5-4df4-bcdd-0db58c82d37f\" (UID: \"e958bcd2-caf5-4df4-bcdd-0db58c82d37f\") " Jul 29 01:01:41.419368 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:41.419347 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e958bcd2-caf5-4df4-bcdd-0db58c82d37f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e958bcd2-caf5-4df4-bcdd-0db58c82d37f" (UID: "e958bcd2-caf5-4df4-bcdd-0db58c82d37f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:01:41.520214 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:41.520182 2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e958bcd2-caf5-4df4-bcdd-0db58c82d37f-maas-api-service-ca\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:42.121349 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:42.121319 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" event={"ID":"e958bcd2-caf5-4df4-bcdd-0db58c82d37f","Type":"ContainerDied","Data":"44443c77c4f93847dc8c506a5a445e03ab8856b3bb397ca7cbb14a98cda98f95"} Jul 29 01:01:42.121515 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:42.121361 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44443c77c4f93847dc8c506a5a445e03ab8856b3bb397ca7cbb14a98cda98f95" Jul 29 01:01:42.121515 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:42.121329 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd" Jul 29 01:01:53.426092 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.422104 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:01:53.821409 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.821327 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w"] Jul 29 01:01:53.821620 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.821586 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" podUID="9fdd28e7-d326-4785-8f3c-824af5924687" containerName="payload-processing" containerID="cri-o://9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636" gracePeriod=30 Jul 29 01:01:53.827760 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.827734 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2"] Jul 29 01:01:53.828131 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.828103 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" podUID="594de192-873f-4fa7-b3b1-625725de1303" containerName="payload-pre-processing" containerID="cri-o://d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced" gracePeriod=30 Jul 29 01:01:53.955873 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.955823 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd"] Jul 29 01:01:53.958265 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:53.958240 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-63186d-hbdqd"] Jul 29 01:01:54.078872 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.078807 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 01:01:54.108616 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.108589 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 01:01:54.117808 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.117783 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e958bcd2-caf5-4df4-bcdd-0db58c82d37f" path="/var/lib/kubelet/pods/e958bcd2-caf5-4df4-bcdd-0db58c82d37f/volumes" Jul 29 01:01:54.135625 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.135604 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdd28e7-d326-4785-8f3c-824af5924687-plugins-config-volume\") pod \"9fdd28e7-d326-4785-8f3c-824af5924687\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " Jul 29 01:01:54.135761 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.135742 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckhm7\" (UniqueName: \"kubernetes.io/projected/9fdd28e7-d326-4785-8f3c-824af5924687-kube-api-access-ckhm7\") pod \"9fdd28e7-d326-4785-8f3c-824af5924687\" (UID: \"9fdd28e7-d326-4785-8f3c-824af5924687\") " Jul 29 01:01:54.135989 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.135964 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fdd28e7-d326-4785-8f3c-824af5924687-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9fdd28e7-d326-4785-8f3c-824af5924687" (UID: "9fdd28e7-d326-4785-8f3c-824af5924687"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:01:54.137768 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.137748 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdd28e7-d326-4785-8f3c-824af5924687-kube-api-access-ckhm7" (OuterVolumeSpecName: "kube-api-access-ckhm7") pod "9fdd28e7-d326-4785-8f3c-824af5924687" (UID: "9fdd28e7-d326-4785-8f3c-824af5924687"). InnerVolumeSpecName "kube-api-access-ckhm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:01:54.187440 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.187399 2550 generic.go:356] "Generic (PLEG): container finished" podID="9fdd28e7-d326-4785-8f3c-824af5924687" containerID="9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636" exitCode=0 Jul 29 01:01:54.187586 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.187447 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" Jul 29 01:01:54.187586 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.187481 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" event={"ID":"9fdd28e7-d326-4785-8f3c-824af5924687","Type":"ContainerDied","Data":"9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636"} Jul 29 01:01:54.187586 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.187530 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w" event={"ID":"9fdd28e7-d326-4785-8f3c-824af5924687","Type":"ContainerDied","Data":"a5966b4e69e95938b740830c2afa0b99b31b8f9749a81ffac6fe009f46ecdde5"} Jul 29 01:01:54.187586 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.187583 2550 scope.go:117] "RemoveContainer" containerID="9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636" Jul 29 01:01:54.191921 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.191894 2550 generic.go:356] "Generic (PLEG): container finished" podID="594de192-873f-4fa7-b3b1-625725de1303" containerID="d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced" exitCode=0 Jul 29 01:01:54.192017 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.191944 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" event={"ID":"594de192-873f-4fa7-b3b1-625725de1303","Type":"ContainerDied","Data":"d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced"} Jul 29 01:01:54.192017 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.191982 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" event={"ID":"594de192-873f-4fa7-b3b1-625725de1303","Type":"ContainerDied","Data":"30712d2ec85589b051eeb61429c388aada67bb06ee9b026deca45d89c3a2d20f"} Jul 29 01:01:54.192017 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.192001 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2" Jul 29 01:01:54.199201 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.199181 2550 scope.go:117] "RemoveContainer" containerID="9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636" Jul 29 01:01:54.199440 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:01:54.199419 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636\": container with ID starting with 9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636 not found: ID does not exist" containerID="9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636" Jul 29 01:01:54.199489 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.199447 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636"} err="failed to get container status \"9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636\": rpc error: code = NotFound desc = could not find container \"9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636\": container with ID starting with 9acb28cf6b6848fc2f5afa77bbcedc90e9d8fc7e863ab6be0107f088790e7636 not found: ID does not exist" Jul 29 01:01:54.199489 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.199462 2550 scope.go:117] "RemoveContainer" containerID="d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced" Jul 29 01:01:54.207587 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.207571 2550 scope.go:117] "RemoveContainer" containerID="d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced" Jul 29 01:01:54.207837 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:01:54.207820 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced\": container with ID starting with d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced not found: ID does not exist" containerID="d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced" Jul 29 01:01:54.207891 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.207844 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced"} err="failed to get container status \"d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced\": rpc error: code = NotFound desc = could not find container \"d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced\": container with ID starting with d3470ac626e4494830279caebd6359249e864934cf3d799a08a3d68753742ced not found: ID does not exist" Jul 29 01:01:54.212607 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.212389 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w"] Jul 29 01:01:54.214950 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.214928 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-63186d-c66658bfd-qrf7w"] Jul 29 01:01:54.236805 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.236786 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594de192-873f-4fa7-b3b1-625725de1303-plugins-config-volume\") pod \"594de192-873f-4fa7-b3b1-625725de1303\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " Jul 29 01:01:54.236905 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.236882 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvkbh\" (UniqueName: \"kubernetes.io/projected/594de192-873f-4fa7-b3b1-625725de1303-kube-api-access-nvkbh\") pod \"594de192-873f-4fa7-b3b1-625725de1303\" (UID: \"594de192-873f-4fa7-b3b1-625725de1303\") " Jul 29 01:01:54.237184 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.237159 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594de192-873f-4fa7-b3b1-625725de1303-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "594de192-873f-4fa7-b3b1-625725de1303" (UID: "594de192-873f-4fa7-b3b1-625725de1303"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:01:54.237246 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.237168 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckhm7\" (UniqueName: \"kubernetes.io/projected/9fdd28e7-d326-4785-8f3c-824af5924687-kube-api-access-ckhm7\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:54.237246 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.237213 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fdd28e7-d326-4785-8f3c-824af5924687-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:54.238908 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.238889 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594de192-873f-4fa7-b3b1-625725de1303-kube-api-access-nvkbh" (OuterVolumeSpecName: "kube-api-access-nvkbh") pod "594de192-873f-4fa7-b3b1-625725de1303" (UID: "594de192-873f-4fa7-b3b1-625725de1303"). InnerVolumeSpecName "kube-api-access-nvkbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:01:54.338318 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.338240 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvkbh\" (UniqueName: \"kubernetes.io/projected/594de192-873f-4fa7-b3b1-625725de1303-kube-api-access-nvkbh\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:54.338318 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.338267 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594de192-873f-4fa7-b3b1-625725de1303-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:01:54.513295 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.513268 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2"] Jul 29 01:01:54.516693 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:54.516671 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-63186d-64b7465944-c54f2"] Jul 29 01:01:56.117199 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:56.117165 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594de192-873f-4fa7-b3b1-625725de1303" path="/var/lib/kubelet/pods/594de192-873f-4fa7-b3b1-625725de1303/volumes" Jul 29 01:01:56.117601 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:01:56.117522 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fdd28e7-d326-4785-8f3c-824af5924687" path="/var/lib/kubelet/pods/9fdd28e7-d326-4785-8f3c-824af5924687/volumes" Jul 29 01:02:04.212973 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:04.212938 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:02:42.459576 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.459533 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw"] Jul 29 01:02:42.459992 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.459954 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594de192-873f-4fa7-b3b1-625725de1303" containerName="payload-pre-processing" Jul 29 01:02:42.459992 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.459967 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="594de192-873f-4fa7-b3b1-625725de1303" containerName="payload-pre-processing" Jul 29 01:02:42.459992 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.459976 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fdd28e7-d326-4785-8f3c-824af5924687" containerName="payload-processing" Jul 29 01:02:42.459992 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.459986 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fdd28e7-d326-4785-8f3c-824af5924687" containerName="payload-processing" Jul 29 01:02:42.460155 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.459996 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e958bcd2-caf5-4df4-bcdd-0db58c82d37f" containerName="revoke-keys" Jul 29 01:02:42.460155 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.460003 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="e958bcd2-caf5-4df4-bcdd-0db58c82d37f" containerName="revoke-keys" Jul 29 01:02:42.460155 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.460125 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="e958bcd2-caf5-4df4-bcdd-0db58c82d37f" containerName="revoke-keys" Jul 29 01:02:42.460155 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.460142 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fdd28e7-d326-4785-8f3c-824af5924687" containerName="payload-processing" Jul 29 01:02:42.460155 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.460154 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="594de192-873f-4fa7-b3b1-625725de1303" containerName="payload-pre-processing" Jul 29 01:02:42.464016 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.463997 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:42.467649 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.467621 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\"" Jul 29 01:02:42.467784 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.467635 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 01:02:42.470369 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.470346 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw"] Jul 29 01:02:42.588643 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.588611 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d924be-c151-4f90-90ed-e8d01c542a3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw\" (UID: \"70d924be-c151-4f90-90ed-e8d01c542a3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:42.689524 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.689495 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d924be-c151-4f90-90ed-e8d01c542a3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw\" (UID: \"70d924be-c151-4f90-90ed-e8d01c542a3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:42.690149 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.690130 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d924be-c151-4f90-90ed-e8d01c542a3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw\" (UID: \"70d924be-c151-4f90-90ed-e8d01c542a3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:42.776874 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.776798 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:42.912106 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:42.912072 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw"] Jul 29 01:02:42.912493 ip-10-0-133-130 kubenswrapper[2550]: W0729 01:02:42.912460 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d924be_c151_4f90_90ed_e8d01c542a3e.slice/crio-6fa2f0481b87a183632b55fa74a6e7b9ced8db5c75911d26138fdfdac4f6898d WatchSource:0}: Error finding container 6fa2f0481b87a183632b55fa74a6e7b9ced8db5c75911d26138fdfdac4f6898d: Status 404 returned error can't find the container with id 6fa2f0481b87a183632b55fa74a6e7b9ced8db5c75911d26138fdfdac4f6898d Jul 29 01:02:43.471026 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:43.470989 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" event={"ID":"70d924be-c151-4f90-90ed-e8d01c542a3e","Type":"ContainerStarted","Data":"bce242f00f9a70d2de5820be7422bc931b39bd797393d751ba5da041e7e03c33"} Jul 29 01:02:43.471423 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:43.471042 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" event={"ID":"70d924be-c151-4f90-90ed-e8d01c542a3e","Type":"ContainerStarted","Data":"6fa2f0481b87a183632b55fa74a6e7b9ced8db5c75911d26138fdfdac4f6898d"} Jul 29 01:02:43.488498 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:43.488448 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" podStartSLOduration=1.4884328230000001 podStartE2EDuration="1.488432823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:02:43.487900305 +0000 UTC m=+3260.007228953" watchObservedRunningTime="2026-07-29 01:02:43.488432823 +0000 UTC m=+3260.007761470" Jul 29 01:02:44.477985 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:44.477944 2550 generic.go:356] "Generic (PLEG): container finished" podID="70d924be-c151-4f90-90ed-e8d01c542a3e" containerID="bce242f00f9a70d2de5820be7422bc931b39bd797393d751ba5da041e7e03c33" exitCode=0 Jul 29 01:02:44.478378 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:44.477995 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" event={"ID":"70d924be-c151-4f90-90ed-e8d01c542a3e","Type":"ContainerDied","Data":"bce242f00f9a70d2de5820be7422bc931b39bd797393d751ba5da041e7e03c33"} Jul 29 01:02:45.621865 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:45.621835 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:45.714895 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:45.714866 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d924be-c151-4f90-90ed-e8d01c542a3e-maas-api-service-ca\") pod \"70d924be-c151-4f90-90ed-e8d01c542a3e\" (UID: \"70d924be-c151-4f90-90ed-e8d01c542a3e\") " Jul 29 01:02:45.715265 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:45.715235 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d924be-c151-4f90-90ed-e8d01c542a3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70d924be-c151-4f90-90ed-e8d01c542a3e" (UID: "70d924be-c151-4f90-90ed-e8d01c542a3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:02:45.815940 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:45.815864 2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d924be-c151-4f90-90ed-e8d01c542a3e-maas-api-service-ca\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:02:46.490319 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:46.490292 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" Jul 29 01:02:46.490488 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:46.490319 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw" event={"ID":"70d924be-c151-4f90-90ed-e8d01c542a3e","Type":"ContainerDied","Data":"6fa2f0481b87a183632b55fa74a6e7b9ced8db5c75911d26138fdfdac4f6898d"} Jul 29 01:02:46.490488 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:46.490360 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fa2f0481b87a183632b55fa74a6e7b9ced8db5c75911d26138fdfdac4f6898d" Jul 29 01:02:53.136561 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.136510 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2"] Jul 29 01:02:53.136996 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.136832 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" podUID="47f386fb-617f-40b4-852d-29ccd35f9488" containerName="payload-processing" containerID="cri-o://d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d" gracePeriod=30 Jul 29 01:02:53.145208 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.145136 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7"] Jul 29 01:02:53.145460 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.145406 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" podUID="0c7bb374-1396-44be-8bf0-e6fb35128653" containerName="payload-pre-processing" containerID="cri-o://5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326" gracePeriod=30 Jul 29 01:02:53.274245 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.274202 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw"] Jul 29 01:02:53.276641 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.276613 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-efa6ac-zszlw"] Jul 29 01:02:53.413814 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.413788 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 01:02:53.416490 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.416471 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 01:02:53.532609 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.532577 2550 generic.go:356] "Generic (PLEG): container finished" podID="47f386fb-617f-40b4-852d-29ccd35f9488" containerID="d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d" exitCode=0 Jul 29 01:02:53.532796 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.532620 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" event={"ID":"47f386fb-617f-40b4-852d-29ccd35f9488","Type":"ContainerDied","Data":"d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d"} Jul 29 01:02:53.532796 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.532646 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" Jul 29 01:02:53.532796 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.532686 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2" event={"ID":"47f386fb-617f-40b4-852d-29ccd35f9488","Type":"ContainerDied","Data":"23c6cb8a220114d2e6719985d5a502c775cdd5a41b4a08486859852f73da4553"} Jul 29 01:02:53.532796 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.532704 2550 scope.go:117] "RemoveContainer" containerID="d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d" Jul 29 01:02:53.533956 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.533932 2550 generic.go:356] "Generic (PLEG): container finished" podID="0c7bb374-1396-44be-8bf0-e6fb35128653" containerID="5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326" exitCode=0 Jul 29 01:02:53.534028 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.533978 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" Jul 29 01:02:53.534028 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.534002 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" event={"ID":"0c7bb374-1396-44be-8bf0-e6fb35128653","Type":"ContainerDied","Data":"5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326"} Jul 29 01:02:53.534103 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.534038 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7" event={"ID":"0c7bb374-1396-44be-8bf0-e6fb35128653","Type":"ContainerDied","Data":"2a61958d874f073b3fabb2d2dfd570c9cd2f68f1a702b611efc01026a78dadeb"} Jul 29 01:02:53.541925 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.541911 2550 scope.go:117] "RemoveContainer" containerID="d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d" Jul 29 01:02:53.542190 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:02:53.542169 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d\": container with ID starting with d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d not found: ID does not exist" containerID="d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d" Jul 29 01:02:53.542246 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.542198 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d"} err="failed to get container status \"d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d\": rpc error: code = NotFound desc = could not find container \"d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d\": container with ID starting with d7364fedc87ae37e3783acc481b740f60a0e2023f23b6272c051f8d2296a9d8d not found: ID does not exist" Jul 29 01:02:53.542246 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.542216 2550 scope.go:117] "RemoveContainer" containerID="5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326" Jul 29 01:02:53.551103 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.551085 2550 scope.go:117] "RemoveContainer" containerID="5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326" Jul 29 01:02:53.551423 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:02:53.551398 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326\": container with ID starting with 5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326 not found: ID does not exist" containerID="5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326" Jul 29 01:02:53.551485 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.551430 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326"} err="failed to get container status \"5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326\": rpc error: code = NotFound desc = could not find container \"5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326\": container with ID starting with 5783b05ec5f8fd602aa886e25fd89487070b37d65e404fc7941447a7796f8326 not found: ID does not exist" Jul 29 01:02:53.586616 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.586592 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58nkk\" (UniqueName: \"kubernetes.io/projected/0c7bb374-1396-44be-8bf0-e6fb35128653-kube-api-access-58nkk\") pod \"0c7bb374-1396-44be-8bf0-e6fb35128653\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " Jul 29 01:02:53.586775 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.586632 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47f386fb-617f-40b4-852d-29ccd35f9488-plugins-config-volume\") pod \"47f386fb-617f-40b4-852d-29ccd35f9488\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " Jul 29 01:02:53.586775 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.586664 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdbzd\" (UniqueName: \"kubernetes.io/projected/47f386fb-617f-40b4-852d-29ccd35f9488-kube-api-access-gdbzd\") pod \"47f386fb-617f-40b4-852d-29ccd35f9488\" (UID: \"47f386fb-617f-40b4-852d-29ccd35f9488\") " Jul 29 01:02:53.586775 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.586734 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7bb374-1396-44be-8bf0-e6fb35128653-plugins-config-volume\") pod \"0c7bb374-1396-44be-8bf0-e6fb35128653\" (UID: \"0c7bb374-1396-44be-8bf0-e6fb35128653\") " Jul 29 01:02:53.587051 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.587025 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f386fb-617f-40b4-852d-29ccd35f9488-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47f386fb-617f-40b4-852d-29ccd35f9488" (UID: "47f386fb-617f-40b4-852d-29ccd35f9488"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:02:53.587136 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.587117 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7bb374-1396-44be-8bf0-e6fb35128653-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c7bb374-1396-44be-8bf0-e6fb35128653" (UID: "0c7bb374-1396-44be-8bf0-e6fb35128653"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:02:53.588795 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.588774 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f386fb-617f-40b4-852d-29ccd35f9488-kube-api-access-gdbzd" (OuterVolumeSpecName: "kube-api-access-gdbzd") pod "47f386fb-617f-40b4-852d-29ccd35f9488" (UID: "47f386fb-617f-40b4-852d-29ccd35f9488"). InnerVolumeSpecName "kube-api-access-gdbzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:02:53.588886 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.588799 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7bb374-1396-44be-8bf0-e6fb35128653-kube-api-access-58nkk" (OuterVolumeSpecName: "kube-api-access-58nkk") pod "0c7bb374-1396-44be-8bf0-e6fb35128653" (UID: "0c7bb374-1396-44be-8bf0-e6fb35128653"). InnerVolumeSpecName "kube-api-access-58nkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:02:53.687399 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.687317 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58nkk\" (UniqueName: \"kubernetes.io/projected/0c7bb374-1396-44be-8bf0-e6fb35128653-kube-api-access-58nkk\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:02:53.687399 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.687345 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47f386fb-617f-40b4-852d-29ccd35f9488-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:02:53.687399 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.687358 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdbzd\" (UniqueName: \"kubernetes.io/projected/47f386fb-617f-40b4-852d-29ccd35f9488-kube-api-access-gdbzd\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:02:53.687399 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.687370 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c7bb374-1396-44be-8bf0-e6fb35128653-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:02:53.857939 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.857906 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2"] Jul 29 01:02:53.860121 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.860093 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-efa6ac-866b68bbb4-vmmm2"] Jul 29 01:02:53.869777 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.869753 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7"] Jul 29 01:02:53.873160 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:53.873138 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-efa6ac-bdb66c64-8xzn7"] Jul 29 01:02:54.117220 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:54.117139 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7bb374-1396-44be-8bf0-e6fb35128653" path="/var/lib/kubelet/pods/0c7bb374-1396-44be-8bf0-e6fb35128653/volumes" Jul 29 01:02:54.117624 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:54.117606 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f386fb-617f-40b4-852d-29ccd35f9488" path="/var/lib/kubelet/pods/47f386fb-617f-40b4-852d-29ccd35f9488/volumes" Jul 29 01:02:54.117928 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:54.117914 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d924be-c151-4f90-90ed-e8d01c542a3e" path="/var/lib/kubelet/pods/70d924be-c151-4f90-90ed-e8d01c542a3e/volumes" Jul 29 01:02:56.217329 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:02:56.217298 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:03:11.156038 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.155996 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd"] Jul 29 01:03:11.156516 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.156205 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" podUID="6688b8e1-b590-4585-85df-59a2d6378f46" containerName="payload-processing" containerID="cri-o://ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55" gracePeriod=30 Jul 29 01:03:11.410783 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.410729 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 01:03:11.423175 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.423147 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pftn7\" (UniqueName: \"kubernetes.io/projected/6688b8e1-b590-4585-85df-59a2d6378f46-kube-api-access-pftn7\") pod \"6688b8e1-b590-4585-85df-59a2d6378f46\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " Jul 29 01:03:11.423293 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.423191 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6688b8e1-b590-4585-85df-59a2d6378f46-plugins-config-volume\") pod \"6688b8e1-b590-4585-85df-59a2d6378f46\" (UID: \"6688b8e1-b590-4585-85df-59a2d6378f46\") " Jul 29 01:03:11.423577 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.423533 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6688b8e1-b590-4585-85df-59a2d6378f46-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6688b8e1-b590-4585-85df-59a2d6378f46" (UID: "6688b8e1-b590-4585-85df-59a2d6378f46"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:03:11.425183 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.425132 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6688b8e1-b590-4585-85df-59a2d6378f46-kube-api-access-pftn7" (OuterVolumeSpecName: "kube-api-access-pftn7") pod "6688b8e1-b590-4585-85df-59a2d6378f46" (UID: "6688b8e1-b590-4585-85df-59a2d6378f46"). InnerVolumeSpecName "kube-api-access-pftn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:03:11.523903 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.523877 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pftn7\" (UniqueName: \"kubernetes.io/projected/6688b8e1-b590-4585-85df-59a2d6378f46-kube-api-access-pftn7\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:03:11.523903 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.523904 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6688b8e1-b590-4585-85df-59a2d6378f46-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:03:11.640994 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.640962 2550 generic.go:356] "Generic (PLEG): container finished" podID="6688b8e1-b590-4585-85df-59a2d6378f46" containerID="ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55" exitCode=0 Jul 29 01:03:11.641150 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.641002 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" event={"ID":"6688b8e1-b590-4585-85df-59a2d6378f46","Type":"ContainerDied","Data":"ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55"} Jul 29 01:03:11.641150 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.641059 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" event={"ID":"6688b8e1-b590-4585-85df-59a2d6378f46","Type":"ContainerDied","Data":"fe5fb01362011e877431780f39d76ee2243b027c14deb8223d03e4245bd9b042"} Jul 29 01:03:11.641150 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.641081 2550 scope.go:117] "RemoveContainer" containerID="ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55" Jul 29 01:03:11.641150 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.641011 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd" Jul 29 01:03:11.650667 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.650618 2550 scope.go:117] "RemoveContainer" containerID="ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55" Jul 29 01:03:11.650887 ip-10-0-133-130 kubenswrapper[2550]: E0729 01:03:11.650867 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55\": container with ID starting with ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55 not found: ID does not exist" containerID="ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55" Jul 29 01:03:11.650950 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.650899 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55"} err="failed to get container status \"ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55\": rpc error: code = NotFound desc = could not find container \"ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55\": container with ID starting with ba160f0d1935ffd35b80eb994195e27d1e4198439ef592cc56a757cff9801d55 not found: ID does not exist" Jul 29 01:03:11.663769 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.663709 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd"] Jul 29 01:03:11.665938 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:11.665916 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d90846-566b47f498-c4vdd"] Jul 29 01:03:12.117613 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:12.117503 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6688b8e1-b590-4585-85df-59a2d6378f46" path="/var/lib/kubelet/pods/6688b8e1-b590-4585-85df-59a2d6378f46/volumes" Jul 29 01:03:14.508752 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:14.508716 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:03:28.583010 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.582977 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k"] Jul 29 01:03:28.583588 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.583394 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" podUID="cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" containerName="payload-processing" containerID="cri-o://ff7dc3531e920bfc3131c8412b2635e5477d98d8ded615aff69f9c1fbc8d82d4" gracePeriod=30 Jul 29 01:03:28.591753 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.591615 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7"] Jul 29 01:03:28.591885 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.591840 2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" podUID="93738ff5-d0f2-4785-b199-61a82f5a0f8b" containerName="payload-pre-processing" containerID="cri-o://4f9cc771c79e0f5ebf346f5a8079c23c604f4f34b088b9ac38cef0bcd10740e8" gracePeriod=30 Jul 29 01:03:28.736194 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.736071 2550 generic.go:356] "Generic (PLEG): container finished" podID="93738ff5-d0f2-4785-b199-61a82f5a0f8b" containerID="4f9cc771c79e0f5ebf346f5a8079c23c604f4f34b088b9ac38cef0bcd10740e8" exitCode=0 Jul 29 01:03:28.736194 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.736112 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" event={"ID":"93738ff5-d0f2-4785-b199-61a82f5a0f8b","Type":"ContainerDied","Data":"4f9cc771c79e0f5ebf346f5a8079c23c604f4f34b088b9ac38cef0bcd10740e8"} Jul 29 01:03:28.737991 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.737967 2550 generic.go:356] "Generic (PLEG): container finished" podID="cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" containerID="ff7dc3531e920bfc3131c8412b2635e5477d98d8ded615aff69f9c1fbc8d82d4" exitCode=0 Jul 29 01:03:28.738109 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.738047 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" event={"ID":"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f","Type":"ContainerDied","Data":"ff7dc3531e920bfc3131c8412b2635e5477d98d8ded615aff69f9c1fbc8d82d4"} Jul 29 01:03:28.866594 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.866575 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 01:03:28.869307 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.869288 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 01:03:28.976671 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.976642 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsq86\" (UniqueName: \"kubernetes.io/projected/93738ff5-d0f2-4785-b199-61a82f5a0f8b-kube-api-access-lsq86\") pod \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " Jul 29 01:03:28.976861 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.976832 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93738ff5-d0f2-4785-b199-61a82f5a0f8b-plugins-config-volume\") pod \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\" (UID: \"93738ff5-d0f2-4785-b199-61a82f5a0f8b\") " Jul 29 01:03:28.976861 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.976861 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-plugins-config-volume\") pod \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " Jul 29 01:03:28.976991 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.976885 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-kube-api-access-ztvzr\") pod \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\" (UID: \"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f\") " Jul 29 01:03:28.977247 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.977223 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93738ff5-d0f2-4785-b199-61a82f5a0f8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93738ff5-d0f2-4785-b199-61a82f5a0f8b" (UID: "93738ff5-d0f2-4785-b199-61a82f5a0f8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:03:28.977299 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.977261 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" (UID: "cc00c9e9-ef96-4a16-b4b9-1440319e9d0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 01:03:28.978798 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.978770 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93738ff5-d0f2-4785-b199-61a82f5a0f8b-kube-api-access-lsq86" (OuterVolumeSpecName: "kube-api-access-lsq86") pod "93738ff5-d0f2-4785-b199-61a82f5a0f8b" (UID: "93738ff5-d0f2-4785-b199-61a82f5a0f8b"). InnerVolumeSpecName "kube-api-access-lsq86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:03:28.978943 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:28.978926 2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-kube-api-access-ztvzr" (OuterVolumeSpecName: "kube-api-access-ztvzr") pod "cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" (UID: "cc00c9e9-ef96-4a16-b4b9-1440319e9d0f"). InnerVolumeSpecName "kube-api-access-ztvzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 01:03:29.077996 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.077967 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-kube-api-access-ztvzr\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:03:29.077996 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.077991 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsq86\" (UniqueName: \"kubernetes.io/projected/93738ff5-d0f2-4785-b199-61a82f5a0f8b-kube-api-access-lsq86\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:03:29.077996 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.078001 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93738ff5-d0f2-4785-b199-61a82f5a0f8b-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:03:29.078174 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.078010 2550 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f-plugins-config-volume\") on node \"ip-10-0-133-130.ec2.internal\" DevicePath \"\"" Jul 29 01:03:29.744249 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.744217 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" Jul 29 01:03:29.744728 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.744213 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7" event={"ID":"93738ff5-d0f2-4785-b199-61a82f5a0f8b","Type":"ContainerDied","Data":"64a08091513ecc41df3dd32a5232c884669df90c0dd07121eca9c1b6abec71b7"} Jul 29 01:03:29.744728 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.744382 2550 scope.go:117] "RemoveContainer" containerID="4f9cc771c79e0f5ebf346f5a8079c23c604f4f34b088b9ac38cef0bcd10740e8" Jul 29 01:03:29.745886 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.745742 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" event={"ID":"cc00c9e9-ef96-4a16-b4b9-1440319e9d0f","Type":"ContainerDied","Data":"84bb63e29207ca93d936dacfbe0fefc34f7d46ac49a503e3c5c2b68a66f1b450"} Jul 29 01:03:29.745886 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.745752 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k" Jul 29 01:03:29.755992 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.755969 2550 scope.go:117] "RemoveContainer" containerID="ff7dc3531e920bfc3131c8412b2635e5477d98d8ded615aff69f9c1fbc8d82d4" Jul 29 01:03:29.791865 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.791830 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7"] Jul 29 01:03:29.798431 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.798408 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-12505f-66d965786d-pl9g7"] Jul 29 01:03:29.826482 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.826453 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k"] Jul 29 01:03:29.828839 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:29.828819 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-12505f-5757887b58-jck6k"] Jul 29 01:03:30.116914 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:30.116838 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93738ff5-d0f2-4785-b199-61a82f5a0f8b" path="/var/lib/kubelet/pods/93738ff5-d0f2-4785-b199-61a82f5a0f8b/volumes" Jul 29 01:03:30.117186 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:30.117173 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" path="/var/lib/kubelet/pods/cc00c9e9-ef96-4a16-b4b9-1440319e9d0f/volumes" Jul 29 01:03:31.423105 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:31.423057 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kc4jf"] Jul 29 01:03:36.254497 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:36.254469 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64767b87f8-xb9qx_d391be09-b027-48c1-8f58-c3275e61bd1a/authorino/0.log" Jul 29 01:03:42.174190 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:42.174162 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-v9khd_c4f8507d-92d1-4fac-9e6b-e65830ae344f/server/0.log" Jul 29 01:03:42.411259 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:42.411232 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-b7rrr_a7103351-fd2f-4688-bb29-72e35b2a2018/copy-manifests/0.log" Jul 29 01:03:42.425036 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:42.424966 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-b7rrr_a7103351-fd2f-4688-bb29-72e35b2a2018/manager/0.log" Jul 29 01:03:44.241755 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.241729 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm_d16644df-9040-46c5-a363-2b86c2fd4286/util/0.log" Jul 29 01:03:44.248886 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.248867 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm_d16644df-9040-46c5-a363-2b86c2fd4286/pull/0.log" Jul 29 01:03:44.255870 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.255834 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm_d16644df-9040-46c5-a363-2b86c2fd4286/extract/0.log" Jul 29 01:03:44.367017 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.366992 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s_7a614c93-0122-4606-bdb1-119bfc0e36ce/util/0.log" Jul 29 01:03:44.373143 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.373119 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s_7a614c93-0122-4606-bdb1-119bfc0e36ce/pull/0.log" Jul 29 01:03:44.379233 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.379215 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s_7a614c93-0122-4606-bdb1-119bfc0e36ce/extract/0.log" Jul 29 01:03:44.491364 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.491342 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6_9cb0ac2f-7b2f-4978-a99c-937da3063c68/util/0.log" Jul 29 01:03:44.498357 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.498300 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6_9cb0ac2f-7b2f-4978-a99c-937da3063c68/pull/0.log" Jul 29 01:03:44.504613 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.504596 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6_9cb0ac2f-7b2f-4978-a99c-937da3063c68/extract/0.log" Jul 29 01:03:44.618867 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.618842 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6_3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327/util/0.log" Jul 29 01:03:44.625689 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.625672 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6_3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327/pull/0.log" Jul 29 01:03:44.632268 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.632250 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6_3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327/extract/0.log" Jul 29 01:03:44.752163 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:44.752095 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64767b87f8-xb9qx_d391be09-b027-48c1-8f58-c3275e61bd1a/authorino/0.log" Jul 29 01:03:45.116756 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:45.116654 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s4sz2_875d4fd9-cb75-48e9-943f-483b5871ad82/kuadrant-console-plugin/0.log" Jul 29 01:03:45.460245 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:45.460215 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kc4jf_39107a55-f9e9-43d5-9a50-dabd8b41b748/limitador/0.log" Jul 29 01:03:46.183708 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:46.183681 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6998fb56fc-g72vg_05767711-4ab6-403d-83fb-ee5982db9dea/kube-auth-proxy/0.log" Jul 29 01:03:47.488827 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:47.488801 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh57zz_ebf57a72-79c0-496c-b287-0e580e84030f/main/0.log" Jul 29 01:03:56.376082 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:56.376054 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x7qbk_eb77e36d-b896-458b-8dab-8bac9eabde23/global-pull-secret-syncer/0.log" Jul 29 01:03:56.507886 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:56.507852 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kgd76_3805e8fb-5970-4290-9b9f-ed9edbbb33da/konnectivity-agent/0.log" Jul 29 01:03:56.546979 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:03:56.546958 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-130.ec2.internal_59375038913e807bad244432c11c8feb/haproxy/0.log" Jul 29 01:04:01.103340 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.103258 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm_d16644df-9040-46c5-a363-2b86c2fd4286/extract/0.log" Jul 29 01:04:01.125510 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.125481 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm_d16644df-9040-46c5-a363-2b86c2fd4286/util/0.log" Jul 29 01:04:01.149202 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.149176 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595mlxm_d16644df-9040-46c5-a363-2b86c2fd4286/pull/0.log" Jul 29 01:04:01.171248 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.171228 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s_7a614c93-0122-4606-bdb1-119bfc0e36ce/extract/0.log" Jul 29 01:04:01.190579 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.190542 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s_7a614c93-0122-4606-bdb1-119bfc0e36ce/util/0.log" Jul 29 01:04:01.210396 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.210372 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9c9s_7a614c93-0122-4606-bdb1-119bfc0e36ce/pull/0.log" Jul 29 01:04:01.239883 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.239860 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6_9cb0ac2f-7b2f-4978-a99c-937da3063c68/extract/0.log" Jul 29 01:04:01.265971 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.265950 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6_9cb0ac2f-7b2f-4978-a99c-937da3063c68/util/0.log" Jul 29 01:04:01.287954 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.287939 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtw6_9cb0ac2f-7b2f-4978-a99c-937da3063c68/pull/0.log" Jul 29 01:04:01.314498 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.314482 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6_3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327/extract/0.log" Jul 29 01:04:01.340273 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.340250 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6_3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327/util/0.log" Jul 29 01:04:01.360083 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.360028 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef182zl6_3e7a0c3c-05bf-4f12-bfdd-56a39ec2d327/pull/0.log" Jul 29 01:04:01.707027 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.706992 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64767b87f8-xb9qx_d391be09-b027-48c1-8f58-c3275e61bd1a/authorino/0.log" Jul 29 01:04:01.806668 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:01.806644 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s4sz2_875d4fd9-cb75-48e9-943f-483b5871ad82/kuadrant-console-plugin/0.log" Jul 29 01:04:02.071509 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:02.071422 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kc4jf_39107a55-f9e9-43d5-9a50-dabd8b41b748/limitador/0.log" Jul 29 01:04:04.078220 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.078190 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/alertmanager/0.log" Jul 29 01:04:04.101355 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.101332 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/config-reloader/0.log" Jul 29 01:04:04.127688 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.127670 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/kube-rbac-proxy-web/0.log" Jul 29 01:04:04.149366 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.149348 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/kube-rbac-proxy/0.log" Jul 29 01:04:04.173750 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.173730 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/kube-rbac-proxy-metric/0.log" Jul 29 01:04:04.193562 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.193527 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/prom-label-proxy/0.log" Jul 29 01:04:04.213102 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.213082 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37a99a74-5698-4e8b-a56b-5ec0a621ad6b/init-config-reloader/0.log" Jul 29 01:04:04.282187 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.282163 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xzgws_eb57dbb9-54d8-426a-a546-38e52a708e4e/kube-state-metrics/0.log" Jul 29 01:04:04.303894 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.303871 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xzgws_eb57dbb9-54d8-426a-a546-38e52a708e4e/kube-rbac-proxy-main/0.log" Jul 29 01:04:04.323905 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.323883 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xzgws_eb57dbb9-54d8-426a-a546-38e52a708e4e/kube-rbac-proxy-self/0.log" Jul 29 01:04:04.347922 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.347865 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-545485468d-gmfqf_f951deed-5cb2-4054-9053-cc8774bcdc98/metrics-server/0.log" Jul 29 01:04:04.371373 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.371354 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-l74ms_743f6f22-1ce6-40d4-af62-2fdf307d8aa5/monitoring-plugin/0.log" Jul 29 01:04:04.535869 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.535844 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2rhf_09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a/node-exporter/0.log" Jul 29 01:04:04.554677 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.554655 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2rhf_09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a/kube-rbac-proxy/0.log" Jul 29 01:04:04.573546 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.573524 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2rhf_09e1c762-92b8-4c3b-88dc-e4bbe5d37b3a/init-textfile/0.log" Jul 29 01:04:04.605637 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.605583 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qddfr_f52359f9-d318-4ead-b1e7-ddd7c8fdcced/kube-rbac-proxy-main/0.log" Jul 29 01:04:04.624304 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.624286 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qddfr_f52359f9-d318-4ead-b1e7-ddd7c8fdcced/kube-rbac-proxy-self/0.log" Jul 29 01:04:04.645677 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.645657 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qddfr_f52359f9-d318-4ead-b1e7-ddd7c8fdcced/openshift-state-metrics/0.log" Jul 29 01:04:04.682761 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.682729 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/prometheus/0.log" Jul 29 01:04:04.701438 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.701419 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/config-reloader/0.log" Jul 29 01:04:04.726815 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.726796 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/thanos-sidecar/0.log" Jul 29 01:04:04.745489 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.745468 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/kube-rbac-proxy-web/0.log" Jul 29 01:04:04.767867 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.767845 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/kube-rbac-proxy/0.log" Jul 29 01:04:04.786875 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.786854 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/kube-rbac-proxy-thanos/0.log" Jul 29 01:04:04.810204 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.810186 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5ff0ad1-d2a3-41e3-80e8-f6244ecd10c2/init-config-reloader/0.log" Jul 29 01:04:04.895198 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.895176 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59466b94c6-k2cv7_938e55d8-c58f-45e0-9137-46393b2eed95/telemeter-client/0.log" Jul 29 01:04:04.913337 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.913317 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59466b94c6-k2cv7_938e55d8-c58f-45e0-9137-46393b2eed95/reload/0.log" Jul 29 01:04:04.939383 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.939362 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59466b94c6-k2cv7_938e55d8-c58f-45e0-9137-46393b2eed95/kube-rbac-proxy/0.log" Jul 29 01:04:04.979661 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:04.979631 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7966f448d4-ppc4j_46ae86b3-90ca-4d39-bad0-21db21b0cc9b/thanos-query/0.log" Jul 29 01:04:05.006429 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:05.006408 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7966f448d4-ppc4j_46ae86b3-90ca-4d39-bad0-21db21b0cc9b/kube-rbac-proxy-web/0.log" Jul 29 01:04:05.025383 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:05.025365 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7966f448d4-ppc4j_46ae86b3-90ca-4d39-bad0-21db21b0cc9b/kube-rbac-proxy/0.log" Jul 29 01:04:05.042955 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:05.042935 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7966f448d4-ppc4j_46ae86b3-90ca-4d39-bad0-21db21b0cc9b/prom-label-proxy/0.log" Jul 29 01:04:05.067724 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:05.067706 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7966f448d4-ppc4j_46ae86b3-90ca-4d39-bad0-21db21b0cc9b/kube-rbac-proxy-rules/0.log" Jul 29 01:04:05.085536 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:05.085521 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7966f448d4-ppc4j_46ae86b3-90ca-4d39-bad0-21db21b0cc9b/kube-rbac-proxy-metrics/0.log" Jul 29 01:04:06.291263 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291228 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf"] Jul 29 01:04:06.291822 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291792 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6688b8e1-b590-4585-85df-59a2d6378f46" containerName="payload-processing" Jul 29 01:04:06.291822 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291821 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6688b8e1-b590-4585-85df-59a2d6378f46" containerName="payload-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291833 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93738ff5-d0f2-4785-b199-61a82f5a0f8b" containerName="payload-pre-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291839 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="93738ff5-d0f2-4785-b199-61a82f5a0f8b" containerName="payload-pre-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291845 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7bb374-1396-44be-8bf0-e6fb35128653" containerName="payload-pre-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291853 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7bb374-1396-44be-8bf0-e6fb35128653" containerName="payload-pre-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291865 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d924be-c151-4f90-90ed-e8d01c542a3e" containerName="revoke-keys" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291873 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d924be-c151-4f90-90ed-e8d01c542a3e" containerName="revoke-keys" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291889 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" containerName="payload-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291898 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" containerName="payload-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291922 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f386fb-617f-40b4-852d-29ccd35f9488" containerName="payload-processing" Jul 29 01:04:06.291964 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.291930 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f386fb-617f-40b4-852d-29ccd35f9488" containerName="payload-processing" Jul 29 01:04:06.292298 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.292039 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6688b8e1-b590-4585-85df-59a2d6378f46" containerName="payload-processing" Jul 29 01:04:06.292298 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.292061 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d924be-c151-4f90-90ed-e8d01c542a3e" containerName="revoke-keys" Jul 29 01:04:06.292298 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.292069 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7bb374-1396-44be-8bf0-e6fb35128653" containerName="payload-pre-processing" Jul 29 01:04:06.292298 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.292079 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc00c9e9-ef96-4a16-b4b9-1440319e9d0f" containerName="payload-processing" Jul 29 01:04:06.292298 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.292086 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="93738ff5-d0f2-4785-b199-61a82f5a0f8b" containerName="payload-pre-processing" Jul 29 01:04:06.292298 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.292092 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="47f386fb-617f-40b4-852d-29ccd35f9488" containerName="payload-processing" Jul 29 01:04:06.294922 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.294906 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.297536 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.297511 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx6mt\"/\"kube-root-ca.crt\"" Jul 29 01:04:06.298743 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.298727 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx6mt\"/\"openshift-service-ca.crt\"" Jul 29 01:04:06.298804 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.298748 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dx6mt\"/\"default-dockercfg-xvggr\"" Jul 29 01:04:06.303881 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.303860 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf"] Jul 29 01:04:06.407873 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.407842 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-podres\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.408047 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.407889 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-lib-modules\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.408047 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.407917 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7576\" (UniqueName: \"kubernetes.io/projected/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-kube-api-access-b7576\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.408047 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.407980 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-proc\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.408047 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.408027 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-sys\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508389 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508358 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-podres\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508532 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508400 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-lib-modules\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508532 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508432 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7576\" (UniqueName: \"kubernetes.io/projected/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-kube-api-access-b7576\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508532 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508463 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-proc\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508532 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508499 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-sys\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508532 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508510 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-podres\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508775 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508605 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-sys\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508775 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508614 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-lib-modules\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.508775 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.508607 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-proc\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.518590 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.518564 2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7576\" (UniqueName: \"kubernetes.io/projected/99d0e40d-9490-4ea4-aca7-9b5d1b924a17-kube-api-access-b7576\") pod \"perf-node-gather-daemonset-kk6mf\" (UID: \"99d0e40d-9490-4ea4-aca7-9b5d1b924a17\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.605823 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.605745 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.741470 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.739893 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf"] Jul 29 01:04:06.741702 ip-10-0-133-130 kubenswrapper[2550]: W0729 01:04:06.741670 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod99d0e40d_9490_4ea4_aca7_9b5d1b924a17.slice/crio-afed19fa05180fb8afa0c9ef15af5053ab5fa2224b18e9a6ab8a831d43c60210 WatchSource:0}: Error finding container afed19fa05180fb8afa0c9ef15af5053ab5fa2224b18e9a6ab8a831d43c60210: Status 404 returned error can't find the container with id afed19fa05180fb8afa0c9ef15af5053ab5fa2224b18e9a6ab8a831d43c60210 Jul 29 01:04:06.955532 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.955496 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" event={"ID":"99d0e40d-9490-4ea4-aca7-9b5d1b924a17","Type":"ContainerStarted","Data":"867e8c7fb1a79c96b113273bb26cbab0226c34dec60861cb5f6e82659c399706"} Jul 29 01:04:06.955680 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.955573 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" event={"ID":"99d0e40d-9490-4ea4-aca7-9b5d1b924a17","Type":"ContainerStarted","Data":"afed19fa05180fb8afa0c9ef15af5053ab5fa2224b18e9a6ab8a831d43c60210"} Jul 29 01:04:06.955680 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.955602 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:06.971915 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:06.971868 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" podStartSLOduration=0.971851845 podStartE2EDuration="971.851845ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:04:06.969916146 +0000 UTC m=+3343.489244791" watchObservedRunningTime="2026-07-29 01:04:06.971851845 +0000 UTC m=+3343.491180490" Jul 29 01:04:09.005308 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:09.005282 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tff7x_39bcddce-b5b9-42f0-af6f-5875a30b38ae/dns/0.log" Jul 29 01:04:09.023426 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:09.023398 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tff7x_39bcddce-b5b9-42f0-af6f-5875a30b38ae/kube-rbac-proxy/0.log" Jul 29 01:04:09.125196 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:09.125170 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xqbv9_d46c1aa8-c028-4f3c-b959-153572e690f8/dns-node-resolver/0.log" Jul 29 01:04:09.664330 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:09.664299 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnlvt_00f2508a-589e-4107-9fb1-d787a989bf56/node-ca/0.log" Jul 29 01:04:10.885425 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:10.885397 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6998fb56fc-g72vg_05767711-4ab6-403d-83fb-ee5982db9dea/kube-auth-proxy/0.log" Jul 29 01:04:11.865279 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:11.865249 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gflr_07f494f4-1efe-42c5-967e-367df3b9d133/serve-healthcheck-canary/0.log" Jul 29 01:04:12.499145 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:12.499116 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlz8x_37e8cb31-31f2-487c-8694-26f2d54569f8/kube-rbac-proxy/0.log" Jul 29 01:04:12.519526 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:12.519492 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlz8x_37e8cb31-31f2-487c-8694-26f2d54569f8/exporter/0.log" Jul 29 01:04:12.540887 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:12.540868 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlz8x_37e8cb31-31f2-487c-8694-26f2d54569f8/extractor/0.log" Jul 29 01:04:12.971271 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:12.971247 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-kk6mf" Jul 29 01:04:15.340844 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:15.340812 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-v9khd_c4f8507d-92d1-4fac-9e6b-e65830ae344f/server/0.log" Jul 29 01:04:15.513987 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:15.513904 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-b7rrr_a7103351-fd2f-4688-bb29-72e35b2a2018/manager/0.log" Jul 29 01:04:15.529943 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:15.529921 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-b7rrr_a7103351-fd2f-4688-bb29-72e35b2a2018/copy-manifests/0.log" Jul 29 01:04:16.918052 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:16.918023 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-794d6b68f4-tq4mk_c2713c5c-3bdd-47d0-b009-4c1496df1e09/manager/0.log" Jul 29 01:04:17.217465 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:17.217382 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6998fb56fc-g72vg_05767711-4ab6-403d-83fb-ee5982db9dea/kube-auth-proxy/0.log" Jul 29 01:04:18.987999 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:18.987974 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6998fb56fc-g72vg_05767711-4ab6-403d-83fb-ee5982db9dea/kube-auth-proxy/0.log" Jul 29 01:04:23.176174 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.176145 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/kube-multus-additional-cni-plugins/0.log" Jul 29 01:04:23.197376 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.197350 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/egress-router-binary-copy/0.log" Jul 29 01:04:23.220620 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.220597 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/cni-plugins/0.log" Jul 29 01:04:23.239492 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.239472 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/bond-cni-plugin/0.log" Jul 29 01:04:23.258561 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.258528 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/routeoverride-cni/0.log" Jul 29 01:04:23.278622 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.278602 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/whereabouts-cni-bincopy/0.log" Jul 29 01:04:23.299171 ip-10-0-133-130 kubenswrapper[2550]: I0729 01:04:23.299148 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n556_dd40ef28-aae4-4d1b-81e4-9124cc883ba5/whereabouts-cni/0.log"