Jul 07 22:12:49.083044 ip-10-0-142-33 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 22:12:49.083056 ip-10-0-142-33 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 22:12:49.083066 ip-10-0-142-33 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 22:12:49.083365 ip-10-0-142-33 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 22:12:59.222046 ip-10-0-142-33 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 22:12:59.222065 ip-10-0-142-33 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 42e87459c4d440d7999242873ce088bc -- Jul 07 22:15:01.428900 ip-10-0-142-33 systemd[1]: Starting Kubernetes Kubelet... Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.120092 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124820 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124835 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124839 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124843 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124848 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124851 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124854 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 22:15:02.181547 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124857 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124860 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124863 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124865 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124868 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124871 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124874 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124878 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124881 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124884 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124886 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124889 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124892 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124897 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124901 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124905 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124911 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124914 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124917 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 22:15:02.182925 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124920 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124923 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124926 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124929 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124932 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124934 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124937 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124940 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124943 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124945 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124949 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124953 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124956 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124959 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124962 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124965 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124968 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124972 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124976 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124980 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 22:15:02.184192 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124983 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124987 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124990 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124992 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124995 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.124998 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125000 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125003 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125006 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125008 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125011 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125014 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125017 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125020 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125023 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125026 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125029 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125031 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125034 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125037 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 22:15:02.185136 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125039 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125043 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125045 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125048 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125051 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125054 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125056 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125059 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125063 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125066 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125068 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125072 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125075 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125078 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125082 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125086 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125089 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125092 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125095 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125098 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 22:15:02.188208 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125101 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125104 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125107 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125109 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125112 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125115 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125118 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125120 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125123 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125126 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125129 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125131 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125134 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125955 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125964 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125968 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125971 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125974 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125978 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125981 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 22:15:02.189101 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125984 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125987 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125990 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125992 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.125997 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126010 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126015 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126018 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126021 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126024 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126027 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126031 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126034 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126037 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126040 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126043 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126046 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126049 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126052 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126054 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 22:15:02.191318 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126057 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126060 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126063 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126066 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126070 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126074 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126077 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126080 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126083 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126085 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126088 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126090 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126093 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126096 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126098 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126101 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126104 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126108 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126111 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126114 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 22:15:02.192209 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126116 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126119 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126122 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126125 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126128 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126130 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126134 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126136 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126139 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126142 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126144 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126147 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126150 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126152 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126156 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126160 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126163 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126166 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126168 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 22:15:02.193532 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126171 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126174 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126176 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126179 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126183 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126186 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126188 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126191 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126194 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126196 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126199 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126203 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126206 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126208 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126211 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126214 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126217 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126219 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126223 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126226 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 22:15:02.194392 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126229 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126231 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126234 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126237 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126239 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126242 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126245 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126247 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126250 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126252 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126255 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126258 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126261 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126667 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126672 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126675 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126678 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126682 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126699 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126702 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 22:15:02.196624 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126705 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126709 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126712 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126715 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126718 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126721 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126725 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126728 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126731 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126733 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126736 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126739 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126744 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126748 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126753 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126757 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126759 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126762 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126765 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 22:15:02.197520 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126768 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126771 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126774 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126777 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126780 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126782 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126785 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126788 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126790 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126795 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126799 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126802 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126806 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126810 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126813 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126816 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126818 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126822 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126825 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126828 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 22:15:02.200590 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126830 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126833 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126835 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126838 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126841 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126843 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126847 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126850 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126853 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126856 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126858 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126861 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126867 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126869 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126872 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126876 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126880 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126883 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126886 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 22:15:02.201474 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126889 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126892 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126896 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126899 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126901 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126904 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126907 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126911 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126915 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126918 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126920 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126924 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126927 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126930 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126933 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126936 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126939 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126942 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126945 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126948 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 22:15:02.203229 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126950 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126953 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126956 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126958 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126961 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126965 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126968 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126971 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126974 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126977 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126980 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126982 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126985 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.126987 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127070 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127081 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127091 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127099 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127105 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127111 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127118 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127123 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 22:15:02.204122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127127 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127132 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127137 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127140 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127144 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127147 2581 flags.go:64] FLAG: --cgroup-root="" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127150 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127153 2581 flags.go:64] FLAG: --client-ca-file="" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127156 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127159 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127163 2581 flags.go:64] FLAG: --cluster-domain="" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127166 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127170 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127173 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127177 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127182 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127185 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127189 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127193 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127196 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127199 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127203 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127206 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127209 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 22:15:02.204983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127214 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127217 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127220 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127224 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127227 2581 flags.go:64] FLAG: --enable-server="true" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127230 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127235 2581 flags.go:64] FLAG: --event-burst="100" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127238 2581 flags.go:64] FLAG: --event-qps="50" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127241 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127246 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127249 2581 flags.go:64] FLAG: --eviction-hard="" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127253 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127256 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127260 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127263 2581 flags.go:64] FLAG: --eviction-soft="" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127266 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127269 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127272 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127275 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127278 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127281 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127284 2581 flags.go:64] FLAG: --feature-gates="" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127288 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127292 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127296 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 22:15:02.205884 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127299 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127302 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127305 2581 flags.go:64] FLAG: --help="false" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127308 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-33.ec2.internal" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127311 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127314 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127317 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127321 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127324 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127327 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127330 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127333 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127336 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127339 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127342 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127345 2581 flags.go:64] FLAG: --kube-reserved="" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127350 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127353 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127356 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127362 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127366 2581 flags.go:64] FLAG: --lock-file="" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127369 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127372 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127375 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 22:15:02.208928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127380 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127383 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127386 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127389 2581 flags.go:64] FLAG: --logging-format="text" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127392 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127396 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127401 2581 flags.go:64] FLAG: --manifest-url="" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127403 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127408 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127411 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127415 2581 flags.go:64] FLAG: --max-pods="110" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127418 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127421 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127424 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127427 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127431 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127434 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127437 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127445 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127448 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127451 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127455 2581 flags.go:64] FLAG: --pod-cidr="" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127458 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 22:15:02.210263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127464 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127467 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127471 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127474 2581 flags.go:64] FLAG: --port="10250" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127478 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127481 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-022370865eabe3cdf" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127485 2581 flags.go:64] FLAG: --qos-reserved="" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127488 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127491 2581 flags.go:64] FLAG: --register-node="true" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127494 2581 flags.go:64] FLAG: --register-with-taints="" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127498 2581 flags.go:64] FLAG: --registry-burst="10" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127501 2581 flags.go:64] FLAG: --registry-qps="5" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127504 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127507 2581 flags.go:64] FLAG: --reserved-memory="" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127511 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127515 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127518 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127521 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127524 2581 flags.go:64] FLAG: --runonce="false" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127527 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127530 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127533 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127537 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127540 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127543 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127546 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 22:15:02.212002 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127550 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127553 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127556 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127559 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127562 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127565 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127568 2581 flags.go:64] FLAG: --system-cgroups="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127571 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127580 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127583 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127586 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127591 2581 flags.go:64] FLAG: --tls-min-version="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127594 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127597 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127600 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127604 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127607 2581 flags.go:64] FLAG: --v="2" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127610 2581 flags.go:64] FLAG: --version="false" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127615 2581 flags.go:64] FLAG: --vmodule="" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127624 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.127627 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127766 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127771 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127775 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 22:15:02.212893 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127778 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127781 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127784 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127786 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127789 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127792 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127795 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127797 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127800 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127803 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127805 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127808 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127811 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127814 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127816 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127819 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127824 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127826 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127829 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127832 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 22:15:02.333302 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127835 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127840 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127844 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127847 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127850 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127853 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127856 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127859 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127862 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127867 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127869 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127872 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127875 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127878 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127881 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127883 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127886 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127889 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127891 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 22:15:02.334168 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127894 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127897 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127900 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127903 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127905 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127908 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127910 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127913 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127916 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127920 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127923 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127926 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127928 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127931 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127934 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127938 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127940 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127943 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127946 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127948 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 22:15:02.336784 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127951 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127954 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127959 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127962 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127965 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127968 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127970 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127973 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127976 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127979 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127981 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127984 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127987 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127989 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127992 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127995 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.127998 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128001 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128005 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 22:15:02.337652 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128008 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128011 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128016 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128019 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128021 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128024 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128027 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128030 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128033 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128036 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128039 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128042 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128046 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128050 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128053 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128057 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128061 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 22:15:02.339855 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.128064 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.128070 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.135700 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.135715 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.135730 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.135740 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135798 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135803 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135807 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135810 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135813 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135817 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135820 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135824 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 22:15:02.340735 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135828 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135832 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135836 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135839 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135842 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135845 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135848 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135850 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135856 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135859 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135862 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135865 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135867 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135870 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135873 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135876 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135879 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135882 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135884 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135888 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 22:15:02.342927 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135891 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135895 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135898 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135900 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135903 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135906 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135909 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135912 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135915 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135917 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135921 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135925 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135928 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135931 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135933 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135936 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135939 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135942 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135945 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 22:15:02.343800 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135948 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135952 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135955 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135958 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135961 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135963 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135966 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135969 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135972 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135974 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135977 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135980 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135982 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135985 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135988 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135991 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135993 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135996 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.135999 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136001 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 22:15:02.348605 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136004 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136007 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136010 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136012 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136015 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136018 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136020 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136023 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136026 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136028 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136035 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136037 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136040 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136046 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136048 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136051 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136054 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136057 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136059 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136062 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 22:15:02.349489 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136065 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136068 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136070 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136073 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136076 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136079 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136081 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136084 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136087 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136090 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136095 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136099 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.136104 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136228 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 22:15:02.353014 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136234 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136238 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136243 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136246 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136249 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136252 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136255 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136258 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136262 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136265 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136268 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136271 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136276 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136278 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136281 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136284 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136287 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136289 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136292 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136294 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 22:15:02.353882 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136297 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136300 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136303 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136305 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136308 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136311 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136313 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136317 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136320 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136323 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136325 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136328 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136331 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136333 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136336 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136339 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136341 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136344 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136347 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136349 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 22:15:02.358674 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136353 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136356 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136358 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136361 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136365 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136368 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136371 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136373 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136376 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136379 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136382 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136384 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136387 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136390 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136392 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136395 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136398 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136401 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136403 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 22:15:02.359554 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136406 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136409 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136413 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136417 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136420 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136423 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136426 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136429 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136432 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136434 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136437 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136451 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136455 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136459 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136462 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136465 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136468 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136472 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136475 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 22:15:02.365242 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136478 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136481 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136484 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136486 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136489 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136492 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136495 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136497 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136500 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136503 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136505 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136508 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136511 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136515 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136518 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136522 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136525 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136528 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136531 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 22:15:02.366131 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:02.136533 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.136538 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.136643 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.139794 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.141507 2581 server.go:1019] "Starting client certificate rotation" Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.145499 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.147596 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.147624 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 22:15:02.369649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.147628 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 22:15:02.898665 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.898639 2581 log.go:25] "Validated CRI v1 runtime API" Jul 07 22:15:02.901283 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.901247 2581 log.go:25] "Validated CRI v1 image API" Jul 07 22:15:02.903068 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.903046 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 22:15:02.905402 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.905381 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88119b92-c490-4d1d-be29-ca9d67660a85:/dev/nvme0n1p3 db65a4f6-3d3e-4d7d-aad0-e93bf7082950:/dev/nvme0n1p4] Jul 07 22:15:02.905453 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.905402 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 22:15:02.910871 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.910754 2581 manager.go:216] Machine: {Timestamp:2026-07-07 22:15:02.909363187 +0000 UTC m=+1.368066839 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099882 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f28bde88e12f24c80420bf0344333 SystemUUID:ec2f28bd-e88e-12f2-4c80-420bf0344333 BootID:42e87459-c4d4-40d7-9992-42873ce088bc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:63:29:8c:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:63:29:8c:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:ec:1e:f4:f0:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 22:15:02.910871 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.910862 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 22:15:02.911013 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.910953 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 22:15:02.913240 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.913212 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 22:15:02.913391 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.913244 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 22:15:02.914029 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.914018 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 22:15:02.914076 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.914030 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 22:15:02.914076 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.914039 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 22:15:02.915423 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.915411 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 22:15:02.916749 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.916738 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 22:15:02.919741 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919728 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 07 22:15:02.919864 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919854 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 22:15:02.919896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919885 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 07 22:15:02.919896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919896 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 22:15:02.919960 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919907 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 22:15:02.919960 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919917 2581 kubelet.go:398] "Adding apiserver pod source" Jul 07 22:15:02.919960 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.919927 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 22:15:02.920310 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.920298 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 22:15:02.920359 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.920316 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 22:15:02.921259 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.921241 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 22:15:02.922463 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.922448 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 22:15:02.924431 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.924416 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 22:15:02.924481 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.924450 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 22:15:02.925658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925646 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 22:15:02.925723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925663 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 22:15:02.925723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925669 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 22:15:02.925723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925674 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 22:15:02.925723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925702 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 22:15:02.925723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925712 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 22:15:02.925723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925724 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925730 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925737 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925743 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925759 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925765 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925796 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 22:15:02.925896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.925806 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 22:15:02.929633 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.929618 2581 server.go:1268] "Started kubelet" Jul 07 22:15:02.929759 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.929711 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 22:15:02.929817 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.929783 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 22:15:02.929878 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.929811 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 22:15:02.930681 ip-10-0-142-33 systemd[1]: Started Kubernetes Kubelet. Jul 07 22:15:02.931369 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.931027 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 07 22:15:02.931552 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.931517 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 22:15:02.933075 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.933056 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 22:15:02.933694 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.933667 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 22:15:02.933783 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.933668 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 22:15:02.935889 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.935861 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 22:15:02.938441 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.938422 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 22:15:02.938441 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.938428 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 22:15:02.938603 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.938588 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:02.939255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939238 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 22:15:02.939336 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939261 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 22:15:02.939336 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939238 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 22:15:02.939451 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939397 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 07 22:15:02.939451 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939407 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 07 22:15:02.939546 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939484 2581 factory.go:55] Registering systemd factory Jul 07 22:15:02.939546 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939505 2581 factory.go:223] Registration of the systemd container factory successfully Jul 07 22:15:02.939802 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.936028 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-33.ec2.internal.18c021b27d58ef05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-33.ec2.internal,UID:ip-10-0-142-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-33.ec2.internal,},FirstTimestamp:2026-07-07 22:15:02.929592069 +0000 UTC m=+1.388295718,LastTimestamp:2026-07-07 22:15:02.929592069 +0000 UTC m=+1.388295718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-33.ec2.internal,}" Jul 07 22:15:02.939909 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939890 2581 factory.go:153] Registering CRI-O factory Jul 07 22:15:02.939909 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939905 2581 factory.go:223] Registration of the crio container factory successfully Jul 07 22:15:02.940012 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939963 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 22:15:02.940012 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.939998 2581 factory.go:103] Registering Raw factory Jul 07 22:15:02.940233 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.940014 2581 manager.go:1196] Started watching for new ooms in manager Jul 07 22:15:02.941626 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.941591 2581 manager.go:349] Starting recovery of all containers Jul 07 22:15:02.945436 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.945406 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 22:15:02.945552 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.945507 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 22:15:02.951963 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.951948 2581 manager.go:354] Recovery completed Jul 07 22:15:02.956066 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.956053 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:02.958254 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.958233 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:02.958321 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.958268 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:02.958321 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.958278 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:02.959192 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.959174 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 22:15:02.959192 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.959191 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:02.959304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.959192 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 22:15:02.959304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.959268 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 07 22:15:02.959974 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.959954 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:02.960079 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.959988 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:02.960079 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.960002 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:02.960160 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.960097 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-33.ec2.internal.18c021b27f0e4903 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-33.ec2.internal,UID:ip-10-0-142-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-33.ec2.internal,},FirstTimestamp:2026-07-07 22:15:02.958254339 +0000 UTC m=+1.416957990,LastTimestamp:2026-07-07 22:15:02.958254339 +0000 UTC m=+1.416957990,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-33.ec2.internal,}" Jul 07 22:15:02.960580 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.960568 2581 policy_none.go:49] "None policy: Start" Jul 07 22:15:02.960640 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.960585 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 22:15:02.960640 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.960606 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 22:15:02.961623 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.961611 2581 policy_none.go:47] "Start" Jul 07 22:15:02.970001 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.969846 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-33.ec2.internal.18c021b27f0e9050 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-33.ec2.internal,UID:ip-10-0-142-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-33.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-33.ec2.internal,},FirstTimestamp:2026-07-07 22:15:02.958272592 +0000 UTC m=+1.416976239,LastTimestamp:2026-07-07 22:15:02.958272592 +0000 UTC m=+1.416976239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-33.ec2.internal,}" Jul 07 22:15:02.972891 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.972873 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mjjn6" Jul 07 22:15:02.979661 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.979603 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-33.ec2.internal.18c021b27f0eb678 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-33.ec2.internal,UID:ip-10-0-142-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-33.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-33.ec2.internal,},FirstTimestamp:2026-07-07 22:15:02.95828236 +0000 UTC m=+1.416986008,LastTimestamp:2026-07-07 22:15:02.95828236 +0000 UTC m=+1.416986008,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-33.ec2.internal,}" Jul 07 22:15:02.988790 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.988676 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-33.ec2.internal.18c021b27f0e4903\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-33.ec2.internal.18c021b27f0e4903 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-33.ec2.internal,UID:ip-10-0-142-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-33.ec2.internal,},FirstTimestamp:2026-07-07 22:15:02.958254339 +0000 UTC m=+1.416957990,LastTimestamp:2026-07-07 22:15:02.959972694 +0000 UTC m=+1.418676343,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-33.ec2.internal,}" Jul 07 22:15:02.989379 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.989360 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mjjn6" Jul 07 22:15:02.999811 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.999796 2581 manager.go:337] "Starting Device Plugin manager" Jul 07 22:15:02.999885 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:02.999827 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 22:15:02.999885 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:02.999837 2581 server.go:87] "Starting device plugin registration server" Jul 07 22:15:03.000114 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.000094 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 22:15:03.000196 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.000110 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 22:15:03.000251 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.000197 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 22:15:03.000308 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.000272 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 22:15:03.000308 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.000279 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 22:15:03.001704 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.001685 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 22:15:03.001773 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.001730 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.101083 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.101050 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:03.102801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.102101 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:03.102801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.102130 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:03.102801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.102141 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:03.102801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.102463 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.112308 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.112283 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.112308 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.112308 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-33.ec2.internal\": node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.136213 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.136184 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.136899 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.136876 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 22:15:03.138142 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.138126 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 22:15:03.138225 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.138162 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 22:15:03.138225 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.138194 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 22:15:03.138325 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.138235 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 22:15:03.141609 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.141588 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 22:15:03.148408 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.148394 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 22:15:03.148584 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.148565 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 22:15:03.242559 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.242468 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.242559 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.242466 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal"] Jul 07 22:15:03.243097 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.242578 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:03.244635 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.244608 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:03.244724 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.244656 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:03.244724 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.244672 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:03.246396 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.246380 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:03.246531 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.246515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.246580 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.246548 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:03.247130 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.247114 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:03.247206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.247116 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:03.247206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.247167 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:03.247206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.247180 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:03.247206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.247149 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:03.247337 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.247222 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:03.248493 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.248477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.248553 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.248507 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:03.249194 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.249178 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:03.249255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.249209 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:03.249255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.249224 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:03.278409 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.278389 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-33.ec2.internal\" not found" node="ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.283272 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.283258 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-33.ec2.internal\" not found" node="ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.342846 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.342811 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.342974 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.342859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ae3826024bcdb731af0baf693f455d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal\" (UID: \"4ae3826024bcdb731af0baf693f455d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.342974 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.342882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ae3826024bcdb731af0baf693f455d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal\" (UID: \"4ae3826024bcdb731af0baf693f455d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.342974 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.342900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6dbfd7c39ad1e792f6ab1faf67c3a565-config\") pod \"kube-apiserver-proxy-ip-10-0-142-33.ec2.internal\" (UID: \"6dbfd7c39ad1e792f6ab1faf67c3a565\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.443370 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.443320 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.443515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.443379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6dbfd7c39ad1e792f6ab1faf67c3a565-config\") pod \"kube-apiserver-proxy-ip-10-0-142-33.ec2.internal\" (UID: \"6dbfd7c39ad1e792f6ab1faf67c3a565\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.443515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.443405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ae3826024bcdb731af0baf693f455d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal\" (UID: \"4ae3826024bcdb731af0baf693f455d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.443515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.443423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ae3826024bcdb731af0baf693f455d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal\" (UID: \"4ae3826024bcdb731af0baf693f455d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.443515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.443455 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ae3826024bcdb731af0baf693f455d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal\" (UID: \"4ae3826024bcdb731af0baf693f455d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.443515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.443482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6dbfd7c39ad1e792f6ab1faf67c3a565-config\") pod \"kube-apiserver-proxy-ip-10-0-142-33.ec2.internal\" (UID: \"6dbfd7c39ad1e792f6ab1faf67c3a565\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.443515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.443486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ae3826024bcdb731af0baf693f455d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal\" (UID: \"4ae3826024bcdb731af0baf693f455d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.546489 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.546411 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.581752 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.581712 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.587246 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.587227 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" Jul 07 22:15:03.646637 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.646599 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.747788 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.747756 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.848402 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.848325 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.948733 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:03.948697 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:03.992116 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.992078 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 22:10:03 +0000 UTC" deadline="2028-02-04 09:52:10.74221615 +0000 UTC" Jul 07 22:15:03.992116 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:03.992111 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13835h37m6.750109093s" Jul 07 22:15:04.049751 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.049722 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:04.121140 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.121120 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 22:15:04.122504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.122481 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientMemory" Jul 07 22:15:04.122637 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.122516 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 22:15:04.122637 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.122526 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeHasSufficientPID" Jul 07 22:15:04.136266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.136247 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 22:15:04.150321 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.150296 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:04.222425 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:04.222393 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae3826024bcdb731af0baf693f455d3.slice/crio-851b15cd396b3bc2f53c4dbbf717c92c4598e596263e6ccc64cecb3031f60f3c WatchSource:0}: Error finding container 851b15cd396b3bc2f53c4dbbf717c92c4598e596263e6ccc64cecb3031f60f3c: Status 404 returned error can't find the container with id 851b15cd396b3bc2f53c4dbbf717c92c4598e596263e6ccc64cecb3031f60f3c Jul 07 22:15:04.226171 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.226154 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 22:15:04.227632 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.227602 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 22:15:04.250723 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.250699 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:04.285595 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:04.285564 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbfd7c39ad1e792f6ab1faf67c3a565.slice/crio-50c74bf08d6247292c34d9f54aae6c71f668a6b04b9af22cf1dff76111030525 WatchSource:0}: Error finding container 50c74bf08d6247292c34d9f54aae6c71f668a6b04b9af22cf1dff76111030525: Status 404 returned error can't find the container with id 50c74bf08d6247292c34d9f54aae6c71f668a6b04b9af22cf1dff76111030525 Jul 07 22:15:04.351878 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.351853 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:04.452038 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.451963 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-33.ec2.internal\" not found" Jul 07 22:15:04.527237 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.527211 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 22:15:04.539050 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.539030 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" Jul 07 22:15:04.547683 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.547664 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 22:15:04.548557 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.548541 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" Jul 07 22:15:04.556022 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.556006 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 22:15:04.723112 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.722992 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 22:15:04.924563 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.924524 2581 apiserver.go:52] "Watching apiserver" Jul 07 22:15:04.932294 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.932261 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 22:15:04.933835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.933807 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-g25gv","openshift-network-operator/iptables-alerter-j2mz8","kube-system/konnectivity-agent-b2jwl","openshift-cluster-node-tuning-operator/tuned-jfjcb","openshift-image-registry/node-ca-szlv7","openshift-multus/multus-additional-cni-plugins-qjtmk","openshift-multus/multus-fzxxr","openshift-network-diagnostics/network-check-target-mjwhp","openshift-ovn-kubernetes/ovnkube-node-mmj9r","kube-system/global-pull-secret-syncer-tv8b4","kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz","openshift-dns/node-resolver-tfhlz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal"] Jul 07 22:15:04.935472 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.935452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.936962 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.936746 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:04.937993 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.937975 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939290 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939300 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939284 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939445 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 22:15:04.939521 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.939488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.941865 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.940217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xm7k\"" Jul 07 22:15:04.942094 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.942040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f9vtg\"" Jul 07 22:15:04.942204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.942181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 22:15:04.942264 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.942211 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 22:15:04.942981 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.942960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rfnl\"" Jul 07 22:15:04.945011 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.944376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.947574 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4zltn\"" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.947766 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.947976 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.948078 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qx8hv\"" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.948143 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.948221 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.948377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.947974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.950058 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.949272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:04.950949 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.950248 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:04.951668 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.951510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:04.951668 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.951585 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:04.953433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.953412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:04.954140 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-cni-bin\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.954225 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-etc-kubernetes\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.954225 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysctl-conf\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954225 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bc8f067-e9f7-47a8-a118-cfec03bb0846-serviceca\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-cni-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-lib-modules\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlx97\" (UniqueName: \"kubernetes.io/projected/889125a9-3667-48c9-ba23-5bb0251e3d2c-kube-api-access-tlx97\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-multus-certs\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458mb\" (UniqueName: \"kubernetes.io/projected/354606f8-4cbc-4af8-9084-39dcf016d062-kube-api-access-458mb\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-kubernetes\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysctl-d\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-run\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889125a9-3667-48c9-ba23-5bb0251e3d2c-tmp\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-kubelet\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-conf-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-systemd\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-var-lib-kubelet\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-host\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-tuned\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.954703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bc8f067-e9f7-47a8-a118-cfec03bb0846-host\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:04.955293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 22:15:04.955371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-os-release\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-cni-multus\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da70ff2e-0d4f-40b8-b889-24ca68d9d03a-konnectivity-ca\") pod \"konnectivity-agent-b2jwl\" (UID: \"da70ff2e-0d4f-40b8-b889-24ca68d9d03a\") " pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:04.955464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954848 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2zj2b\"" Jul 07 22:15:04.955464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-system-cni-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-cnibin\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955464 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-socket-dir-parent\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-k8s-cni-cncf-io\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-modprobe-d\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysconfig\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgw8v\" (UniqueName: \"kubernetes.io/projected/9bc8f067-e9f7-47a8-a118-cfec03bb0846-kube-api-access-tgw8v\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-daemon-config\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955231 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/354606f8-4cbc-4af8-9084-39dcf016d062-hosts-file\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/354606f8-4cbc-4af8-9084-39dcf016d062-tmp-dir\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:04.955663 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955011 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da70ff2e-0d4f-40b8-b889-24ca68d9d03a-agent-certs\") pod \"konnectivity-agent-b2jwl\" (UID: \"da70ff2e-0d4f-40b8-b889-24ca68d9d03a\") " pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-sys\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85cba916-2b2c-42e7-a6fc-d31e84cc898e-cni-binary-copy\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955109 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lbq4q\"" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-hostroot\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbb47\" (UniqueName: \"kubernetes.io/projected/85cba916-2b2c-42e7-a6fc-d31e84cc898e-kube-api-access-hbb47\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-netns\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.955249 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 22:15:04.956204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.954852 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 22:15:04.956658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.956271 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 22:15:04.956658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.956445 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vg877\"" Jul 07 22:15:04.956658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.956650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.956796 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.956681 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.956928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.956913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:04.957011 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.956991 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:04.958230 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.958131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:04.958230 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:04.958198 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:04.960181 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.960090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:04.961572 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.961398 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 22:15:04.964112 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.964092 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 22:15:04.964304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.964287 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7pzzc\"" Jul 07 22:15:04.964403 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.964384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 22:15:04.964478 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.964461 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 22:15:04.987503 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:04.987461 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dv8xb" Jul 07 22:15:05.010290 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.009476 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dv8xb" Jul 07 22:15:05.040285 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.040257 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 22:15:05.056870 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.056417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-daemon-config\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057021 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.056897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/354606f8-4cbc-4af8-9084-39dcf016d062-hosts-file\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.057021 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.056933 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:05.057021 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.056987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-node-log\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.057021 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-env-overrides\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/354606f8-4cbc-4af8-9084-39dcf016d062-hosts-file\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-daemon-config\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da70ff2e-0d4f-40b8-b889-24ca68d9d03a-agent-certs\") pod \"konnectivity-agent-b2jwl\" (UID: \"da70ff2e-0d4f-40b8-b889-24ca68d9d03a\") " pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85cba916-2b2c-42e7-a6fc-d31e84cc898e-cni-binary-copy\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbb47\" (UniqueName: \"kubernetes.io/projected/85cba916-2b2c-42e7-a6fc-d31e84cc898e-kube-api-access-hbb47\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.057228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84c4v\" (UniqueName: \"kubernetes.io/projected/6ccaa330-156d-4d8f-b110-a9dd92387a87-kube-api-access-84c4v\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/721d58d1-2a79-46a6-ab60-cc26a2de15d5-kube-api-access-5ld5t\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-netns\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-cni-bin\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mppg\" (UniqueName: \"kubernetes.io/projected/e571d82d-77e7-4924-98f2-60190970855a-kube-api-access-2mppg\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-log-socket\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bc8f067-e9f7-47a8-a118-cfec03bb0846-serviceca\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-netns\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-var-lib-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057485 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-cni-bin\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057479 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxvqb\" (UniqueName: \"kubernetes.io/projected/beaabce7-515a-4d2d-bac0-803903527f44-kube-api-access-nxvqb\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-multus-certs\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458mb\" (UniqueName: \"kubernetes.io/projected/354606f8-4cbc-4af8-9084-39dcf016d062-kube-api-access-458mb\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-multus-certs\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.057669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057656 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85cba916-2b2c-42e7-a6fc-d31e84cc898e-cni-binary-copy\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-kubernetes\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-run\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057848 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bc8f067-e9f7-47a8-a118-cfec03bb0846-serviceca\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-conf-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057869 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-kubernetes\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-run\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-conf-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.057979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-sys-fs\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-run-netns\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-ovnkube-script-lib\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-registration-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-systemd\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-var-lib-kubelet\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-host\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058185 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-systemd\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.058442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-tuned\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-system-cni-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-k8s-cni-cncf-io\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058240 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-host\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-socket-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-os-release\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-etc-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-var-lib-kubelet\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-modprobe-d\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysconfig\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058326 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw8v\" (UniqueName: \"kubernetes.io/projected/9bc8f067-e9f7-47a8-a118-cfec03bb0846-kube-api-access-tgw8v\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-system-cni-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/354606f8-4cbc-4af8-9084-39dcf016d062-tmp-dir\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-run-k8s-cni-cncf-io\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysconfig\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-modprobe-d\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ccaa330-156d-4d8f-b110-a9dd92387a87-iptables-alerter-script\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.059227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-sys\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-hostroot\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw96c\" (UniqueName: \"kubernetes.io/projected/85d2bc3c-773d-44f8-934e-7386705b63f1-kube-api-access-kw96c\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-dbus\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058742 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-sys\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/354606f8-4cbc-4af8-9084-39dcf016d062-tmp-dir\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-system-cni-dir\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-hostroot\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-kubelet\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-cni-bin\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-etc-kubernetes\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058910 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-etc-kubernetes\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-systemd\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.058981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysctl-conf\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-cni-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-kubelet-config\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059066 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-cni-dir\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cnibin\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059108 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysctl-conf\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-lib-modules\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlx97\" (UniqueName: \"kubernetes.io/projected/889125a9-3667-48c9-ba23-5bb0251e3d2c-kube-api-access-tlx97\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-device-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-ovn\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-lib-modules\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ccaa330-156d-4d8f-b110-a9dd92387a87-host-slash\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysctl-d\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889125a9-3667-48c9-ba23-5bb0251e3d2c-tmp\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-kubelet\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.060795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bc8f067-e9f7-47a8-a118-cfec03bb0846-host\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-os-release\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-cni-multus\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059424 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-sysctl-d\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059440 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-os-release\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-cni-multus\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059478 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-host-var-lib-kubelet\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059514 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bc8f067-e9f7-47a8-a118-cfec03bb0846-host\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-systemd-units\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-slash\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beaabce7-515a-4d2d-bac0-803903527f44-ovn-node-metrics-cert\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da70ff2e-0d4f-40b8-b889-24ca68d9d03a-konnectivity-ca\") pod \"konnectivity-agent-b2jwl\" (UID: \"da70ff2e-0d4f-40b8-b889-24ca68d9d03a\") " pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-cnibin\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-socket-dir-parent\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-cni-netd\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-ovnkube-config\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-cnibin\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.061525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.059842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85cba916-2b2c-42e7-a6fc-d31e84cc898e-multus-socket-dir-parent\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.062416 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.060218 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da70ff2e-0d4f-40b8-b889-24ca68d9d03a-konnectivity-ca\") pod \"konnectivity-agent-b2jwl\" (UID: \"da70ff2e-0d4f-40b8-b889-24ca68d9d03a\") " pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:05.062509 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.062462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da70ff2e-0d4f-40b8-b889-24ca68d9d03a-agent-certs\") pod \"konnectivity-agent-b2jwl\" (UID: \"da70ff2e-0d4f-40b8-b889-24ca68d9d03a\") " pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:05.062570 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.062544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/889125a9-3667-48c9-ba23-5bb0251e3d2c-etc-tuned\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.062705 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.062689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889125a9-3667-48c9-ba23-5bb0251e3d2c-tmp\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.065478 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.065434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbb47\" (UniqueName: \"kubernetes.io/projected/85cba916-2b2c-42e7-a6fc-d31e84cc898e-kube-api-access-hbb47\") pod \"multus-fzxxr\" (UID: \"85cba916-2b2c-42e7-a6fc-d31e84cc898e\") " pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.065721 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.065694 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-458mb\" (UniqueName: \"kubernetes.io/projected/354606f8-4cbc-4af8-9084-39dcf016d062-kube-api-access-458mb\") pod \"node-resolver-tfhlz\" (UID: \"354606f8-4cbc-4af8-9084-39dcf016d062\") " pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.066982 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.066830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgw8v\" (UniqueName: \"kubernetes.io/projected/9bc8f067-e9f7-47a8-a118-cfec03bb0846-kube-api-access-tgw8v\") pod \"node-ca-szlv7\" (UID: \"9bc8f067-e9f7-47a8-a118-cfec03bb0846\") " pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.066982 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.066942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlx97\" (UniqueName: \"kubernetes.io/projected/889125a9-3667-48c9-ba23-5bb0251e3d2c-kube-api-access-tlx97\") pod \"tuned-jfjcb\" (UID: \"889125a9-3667-48c9-ba23-5bb0251e3d2c\") " pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.142885 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.142803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" event={"ID":"6dbfd7c39ad1e792f6ab1faf67c3a565","Type":"ContainerStarted","Data":"50c74bf08d6247292c34d9f54aae6c71f668a6b04b9af22cf1dff76111030525"} Jul 07 22:15:05.144186 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.144145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" event={"ID":"4ae3826024bcdb731af0baf693f455d3","Type":"ContainerStarted","Data":"851b15cd396b3bc2f53c4dbbf717c92c4598e596263e6ccc64cecb3031f60f3c"} Jul 07 22:15:05.160292 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.160292 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-systemd\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-kubelet-config\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cnibin\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-systemd\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160403 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-kubelet-config\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.160413 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:05.160460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cnibin\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.160472 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:05.660456276 +0000 UTC m=+4.119159910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-device-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160523 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-device-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-ovn\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160600 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ccaa330-156d-4d8f-b110-a9dd92387a87-host-slash\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160660 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-run-ovn\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-systemd-units\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-slash\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160717 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ccaa330-156d-4d8f-b110-a9dd92387a87-host-slash\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-slash\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.160801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160767 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-systemd-units\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beaabce7-515a-4d2d-bac0-803903527f44-ovn-node-metrics-cert\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-cni-netd\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-ovnkube-config\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-cni-netd\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-node-log\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.160952 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-node-log\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.160976 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.161027 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:15:05.661010962 +0000 UTC m=+4.119714600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-env-overrides\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84c4v\" (UniqueName: \"kubernetes.io/projected/6ccaa330-156d-4d8f-b110-a9dd92387a87-kube-api-access-84c4v\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/721d58d1-2a79-46a6-ab60-cc26a2de15d5-kube-api-access-5ld5t\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161208 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mppg\" (UniqueName: \"kubernetes.io/projected/e571d82d-77e7-4924-98f2-60190970855a-kube-api-access-2mppg\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:05.161473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-log-socket\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-ovnkube-config\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161347 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-log-socket\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-var-lib-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxvqb\" (UniqueName: \"kubernetes.io/projected/beaabce7-515a-4d2d-bac0-803903527f44-kube-api-access-nxvqb\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-sys-fs\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-var-lib-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-run-netns\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-ovnkube-script-lib\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-registration-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161534 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-run-netns\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-socket-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-os-release\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-sys-fs\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-registration-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-etc-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ccaa330-156d-4d8f-b110-a9dd92387a87-iptables-alerter-script\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-os-release\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85d2bc3c-773d-44f8-934e-7386705b63f1-socket-dir\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-env-overrides\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw96c\" (UniqueName: \"kubernetes.io/projected/85d2bc3c-773d-44f8-934e-7386705b63f1-kube-api-access-kw96c\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-dbus\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161779 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-etc-openvswitch\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-system-cni-dir\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-system-cni-dir\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-kubelet\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-cni-bin\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-kubelet\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.162991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-dbus\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.161982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beaabce7-515a-4d2d-bac0-803903527f44-host-cni-bin\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.162176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.162195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beaabce7-515a-4d2d-bac0-803903527f44-ovnkube-script-lib\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.162229 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/721d58d1-2a79-46a6-ab60-cc26a2de15d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.162274 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ccaa330-156d-4d8f-b110-a9dd92387a87-iptables-alerter-script\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.162304 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/721d58d1-2a79-46a6-ab60-cc26a2de15d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.163689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.163679 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beaabce7-515a-4d2d-bac0-803903527f44-ovn-node-metrics-cert\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.172173 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.172143 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:05.172173 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.172170 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:05.172358 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.172185 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:05.172358 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.172259 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:15:05.672238182 +0000 UTC m=+4.130941818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:05.174872 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.174849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mppg\" (UniqueName: \"kubernetes.io/projected/e571d82d-77e7-4924-98f2-60190970855a-kube-api-access-2mppg\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:05.175319 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.175296 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/721d58d1-2a79-46a6-ab60-cc26a2de15d5-kube-api-access-5ld5t\") pod \"multus-additional-cni-plugins-qjtmk\" (UID: \"721d58d1-2a79-46a6-ab60-cc26a2de15d5\") " pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.176189 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.176169 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84c4v\" (UniqueName: \"kubernetes.io/projected/6ccaa330-156d-4d8f-b110-a9dd92387a87-kube-api-access-84c4v\") pod \"iptables-alerter-j2mz8\" (UID: \"6ccaa330-156d-4d8f-b110-a9dd92387a87\") " pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.177582 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.177560 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxvqb\" (UniqueName: \"kubernetes.io/projected/beaabce7-515a-4d2d-bac0-803903527f44-kube-api-access-nxvqb\") pod \"ovnkube-node-mmj9r\" (UID: \"beaabce7-515a-4d2d-bac0-803903527f44\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.180104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.180086 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw96c\" (UniqueName: \"kubernetes.io/projected/85d2bc3c-773d-44f8-934e-7386705b63f1-kube-api-access-kw96c\") pod \"aws-ebs-csi-driver-node-6t2bz\" (UID: \"85d2bc3c-773d-44f8-934e-7386705b63f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.255508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.255433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fzxxr" Jul 07 22:15:05.265114 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.265092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfhlz" Jul 07 22:15:05.275699 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.275681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:05.283362 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.283344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" Jul 07 22:15:05.292972 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.292941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-szlv7" Jul 07 22:15:05.302489 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.302467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" Jul 07 22:15:05.312123 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.312105 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:05.320685 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.320664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j2mz8" Jul 07 22:15:05.327240 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.327219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" Jul 07 22:15:05.664905 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.664822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:05.665069 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.664904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:05.665069 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.664984 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:05.665069 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.665024 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:05.665069 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.665061 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:15:06.665041871 +0000 UTC m=+5.123745521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:05.665244 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.665080 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:06.665070896 +0000 UTC m=+5.123774532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:05.765548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:05.765502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:05.765741 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.765699 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:05.765741 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.765726 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:05.765741 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.765743 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:05.765890 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:05.765823 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:15:06.765802094 +0000 UTC m=+5.224505749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:06.012548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:06.012487 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 22:10:04 +0000 UTC" deadline="2027-12-04 10:43:03.940467463 +0000 UTC" Jul 07 22:15:06.012548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:06.012543 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12348h27m57.927928553s" Jul 07 22:15:06.139147 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:06.139112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:06.139295 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.139213 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:06.183822 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:06.183799 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889125a9_3667_48c9_ba23_5bb0251e3d2c.slice/crio-c2b05ae96ddc491a460ce9978180e336437e7be4c3aa76807999e247d9c3fd0d WatchSource:0}: Error finding container c2b05ae96ddc491a460ce9978180e336437e7be4c3aa76807999e247d9c3fd0d: Status 404 returned error can't find the container with id c2b05ae96ddc491a460ce9978180e336437e7be4c3aa76807999e247d9c3fd0d Jul 07 22:15:06.185858 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:06.185832 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cba916_2b2c_42e7_a6fc_d31e84cc898e.slice/crio-d5bad8945e93d168b8d5b78b1aa6b96c261bb37977dce8f99f405cf125a011dd WatchSource:0}: Error finding container d5bad8945e93d168b8d5b78b1aa6b96c261bb37977dce8f99f405cf125a011dd: Status 404 returned error can't find the container with id d5bad8945e93d168b8d5b78b1aa6b96c261bb37977dce8f99f405cf125a011dd Jul 07 22:15:06.189406 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:06.189387 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc8f067_e9f7_47a8_a118_cfec03bb0846.slice/crio-fba585169df2183b240e80e7561eb2191a9e2c08dcfd6c7d7b438ebe87b831b5 WatchSource:0}: Error finding container fba585169df2183b240e80e7561eb2191a9e2c08dcfd6c7d7b438ebe87b831b5: Status 404 returned error can't find the container with id fba585169df2183b240e80e7561eb2191a9e2c08dcfd6c7d7b438ebe87b831b5 Jul 07 22:15:06.190322 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:06.190298 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccaa330_156d_4d8f_b110_a9dd92387a87.slice/crio-ae83ef345dd841abaf2a32244d486c91112066e16cae78c6c30815de14fb12d2 WatchSource:0}: Error finding container ae83ef345dd841abaf2a32244d486c91112066e16cae78c6c30815de14fb12d2: Status 404 returned error can't find the container with id ae83ef345dd841abaf2a32244d486c91112066e16cae78c6c30815de14fb12d2 Jul 07 22:15:06.191097 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:06.191078 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d2bc3c_773d_44f8_934e_7386705b63f1.slice/crio-89324c80140defede48002b90a54b29ff71a15c046626845273567a08d85f9b7 WatchSource:0}: Error finding container 89324c80140defede48002b90a54b29ff71a15c046626845273567a08d85f9b7: Status 404 returned error can't find the container with id 89324c80140defede48002b90a54b29ff71a15c046626845273567a08d85f9b7 Jul 07 22:15:06.192945 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:06.192524 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeaabce7_515a_4d2d_bac0_803903527f44.slice/crio-e9cabb014dd0596bfc411011d1a082fce02b5b9cf136f602cb12053797477bd7 WatchSource:0}: Error finding container e9cabb014dd0596bfc411011d1a082fce02b5b9cf136f602cb12053797477bd7: Status 404 returned error can't find the container with id e9cabb014dd0596bfc411011d1a082fce02b5b9cf136f602cb12053797477bd7 Jul 07 22:15:06.672519 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:06.672020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:06.672519 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.672275 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:06.672519 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:06.672311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:06.672519 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.672354 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:08.672333926 +0000 UTC m=+7.131037571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:06.672519 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.672422 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:06.672519 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.672478 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:15:08.672457986 +0000 UTC m=+7.131161622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:06.774056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:06.773372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:06.774056 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.773529 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:06.774056 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.773550 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:06.774056 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.773563 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:06.774056 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:06.773663 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:15:08.773644271 +0000 UTC m=+7.232347912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:07.013766 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.013698 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 22:10:04 +0000 UTC" deadline="2028-03-07 11:45:46.689456524 +0000 UTC" Jul 07 22:15:07.013766 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.013731 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14605h30m39.675729455s" Jul 07 22:15:07.141371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.141292 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:07.141520 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:07.141440 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:07.141938 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.141918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:07.142046 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:07.142023 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:07.161280 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.161245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" event={"ID":"6dbfd7c39ad1e792f6ab1faf67c3a565","Type":"ContainerStarted","Data":"d22826794974d00b5c136c84cb0893e63bda57dd99d68258daa1bbea5b56daa0"} Jul 07 22:15:07.165454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.165423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfhlz" event={"ID":"354606f8-4cbc-4af8-9084-39dcf016d062","Type":"ContainerStarted","Data":"c3045fca66b9b160e81566b07d42166d87cb3af176226dd73cef2350d93648e9"} Jul 07 22:15:07.167996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.167956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j2mz8" event={"ID":"6ccaa330-156d-4d8f-b110-a9dd92387a87","Type":"ContainerStarted","Data":"ae83ef345dd841abaf2a32244d486c91112066e16cae78c6c30815de14fb12d2"} Jul 07 22:15:07.170703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.170670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b2jwl" event={"ID":"da70ff2e-0d4f-40b8-b889-24ca68d9d03a","Type":"ContainerStarted","Data":"4a4f163469f166aaccb637dba8b3a691d40efe9dc6c12d60327a7f6deb7550ac"} Jul 07 22:15:07.176470 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.175947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" event={"ID":"85d2bc3c-773d-44f8-934e-7386705b63f1","Type":"ContainerStarted","Data":"89324c80140defede48002b90a54b29ff71a15c046626845273567a08d85f9b7"} Jul 07 22:15:07.184273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.182653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fzxxr" event={"ID":"85cba916-2b2c-42e7-a6fc-d31e84cc898e","Type":"ContainerStarted","Data":"d5bad8945e93d168b8d5b78b1aa6b96c261bb37977dce8f99f405cf125a011dd"} Jul 07 22:15:07.184273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.183001 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-33.ec2.internal" podStartSLOduration=3.182985705 podStartE2EDuration="3.182985705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:07.182893222 +0000 UTC m=+5.641596879" watchObservedRunningTime="2026-07-07 22:15:07.182985705 +0000 UTC m=+5.641689354" Jul 07 22:15:07.186936 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.186865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" event={"ID":"889125a9-3667-48c9-ba23-5bb0251e3d2c","Type":"ContainerStarted","Data":"c2b05ae96ddc491a460ce9978180e336437e7be4c3aa76807999e247d9c3fd0d"} Jul 07 22:15:07.198631 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.197921 2581 generic.go:356] "Generic (PLEG): container finished" podID="4ae3826024bcdb731af0baf693f455d3" containerID="e968af9274df571d68cdcb1be3a345d47d9ad3c25bdc3c768d606d0934412de0" exitCode=0 Jul 07 22:15:07.198631 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.198002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" event={"ID":"4ae3826024bcdb731af0baf693f455d3","Type":"ContainerDied","Data":"e968af9274df571d68cdcb1be3a345d47d9ad3c25bdc3c768d606d0934412de0"} Jul 07 22:15:07.217356 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.217330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerStarted","Data":"ef4050b3b77565c31e049786732bb2e7e21afc3d613f4b6e391f181ac485a16e"} Jul 07 22:15:07.222025 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.221899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"e9cabb014dd0596bfc411011d1a082fce02b5b9cf136f602cb12053797477bd7"} Jul 07 22:15:07.223937 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:07.223874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-szlv7" event={"ID":"9bc8f067-e9f7-47a8-a118-cfec03bb0846","Type":"ContainerStarted","Data":"fba585169df2183b240e80e7561eb2191a9e2c08dcfd6c7d7b438ebe87b831b5"} Jul 07 22:15:08.139266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:08.139228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:08.139786 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.139362 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:08.242324 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:08.242285 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" event={"ID":"4ae3826024bcdb731af0baf693f455d3","Type":"ContainerStarted","Data":"863ec0a5b62ce8e06aec7c9364b9e5ccc91fd23d0086f6317491494ad1aba105"} Jul 07 22:15:08.258098 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:08.258043 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-33.ec2.internal" podStartSLOduration=4.258002693 podStartE2EDuration="4.258002693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:08.257198804 +0000 UTC m=+6.715902460" watchObservedRunningTime="2026-07-07 22:15:08.258002693 +0000 UTC m=+6.716706348" Jul 07 22:15:08.688770 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:08.688726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:08.688975 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:08.688810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:08.688975 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.688904 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:08.688975 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.688918 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:08.689122 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.688982 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.688964303 +0000 UTC m=+11.147667939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:08.689122 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.689002 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.688991193 +0000 UTC m=+11.147694832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:08.789512 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:08.789471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:08.789723 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.789689 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:08.789723 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.789714 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:08.789723 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.789727 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:08.789902 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:08.789786 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.789767427 +0000 UTC m=+11.248471067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:09.141364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:09.141281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:09.141882 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:09.141406 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:09.141882 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:09.141800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:09.142008 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:09.141914 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:10.139395 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:10.139361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:10.139596 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:10.139500 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:11.139490 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:11.139456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:11.139955 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:11.139589 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:11.139955 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:11.139657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:11.139955 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:11.139764 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:12.138756 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:12.138690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:12.138929 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.138843 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:12.727233 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:12.727189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:12.727726 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:12.727292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:12.727726 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.727445 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:12.727726 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.727508 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:15:20.727488198 +0000 UTC m=+19.186191855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:12.728055 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.727968 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:12.728055 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.728024 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:20.72800772 +0000 UTC m=+19.186711354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:12.828549 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:12.828508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:12.828758 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.828739 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:12.828827 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.828768 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:12.828827 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.828782 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:12.828920 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:12.828848 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:15:20.828828489 +0000 UTC m=+19.287532137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:13.140109 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:13.139654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:13.140109 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:13.139785 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:13.140109 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:13.139908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:13.140109 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:13.139994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:14.138581 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:14.138450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:14.139024 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:14.138585 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:15.138585 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:15.138547 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:15.139038 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:15.138698 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:15.139038 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:15.139024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:15.139158 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:15.139127 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:16.139224 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:16.139188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:16.139662 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:16.139308 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:17.139337 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:17.139299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:17.139837 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:17.139428 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:17.139837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:17.139299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:17.139837 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:17.139522 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:18.139251 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:18.139211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:18.139425 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:18.139327 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:19.138594 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:19.138552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:19.138785 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:19.138571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:19.138785 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:19.138730 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:19.138912 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:19.138839 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:20.138558 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:20.138524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:20.139021 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.138648 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:20.790494 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:20.790458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:20.790710 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:20.790514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:20.790710 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.790632 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:20.790794 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.790633 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:20.790794 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.790719 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:15:36.790697409 +0000 UTC m=+35.249401042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:20.790794 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.790791 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:36.790773388 +0000 UTC m=+35.249477026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:20.891115 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:20.891078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:20.891290 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.891215 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:20.891290 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.891238 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:20.891290 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.891251 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:20.891443 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:20.891308 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:15:36.891293634 +0000 UTC m=+35.349997273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:21.138646 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:21.138550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:21.139096 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:21.138715 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:21.139096 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:21.138723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:21.139096 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:21.138866 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:22.139287 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:22.139251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:22.139806 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:22.139380 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:23.139559 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:23.139513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:23.140019 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:23.139644 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:23.140019 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:23.139686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:23.140019 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:23.139820 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:24.138658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:24.138621 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:24.138820 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:24.138741 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:25.138926 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.138722 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:25.139327 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:25.139067 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:25.139418 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.138793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:25.139532 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:25.139507 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:25.279193 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.279033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-szlv7" event={"ID":"9bc8f067-e9f7-47a8-a118-cfec03bb0846","Type":"ContainerStarted","Data":"acfc8c80861d6096f9f413df7b1277eca7ca08754a4b57287a5399e5ff352164"} Jul 07 22:15:25.280470 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.280439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfhlz" event={"ID":"354606f8-4cbc-4af8-9084-39dcf016d062","Type":"ContainerStarted","Data":"9565cc98dca869fccd8f6c6f557d288ee90f230e039591ebfbc2b2b213ef3fac"} Jul 07 22:15:25.281803 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.281780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b2jwl" event={"ID":"da70ff2e-0d4f-40b8-b889-24ca68d9d03a","Type":"ContainerStarted","Data":"002f16e7adc0cdd45b42c4e17c68036f69932e88f21d75d5c20a6f7b109d0cd1"} Jul 07 22:15:25.283188 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.283165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" event={"ID":"85d2bc3c-773d-44f8-934e-7386705b63f1","Type":"ContainerStarted","Data":"a08207c01c3c7732f0a67ef240733b71a229c5409322c4dc3df167e3f9d01c19"} Jul 07 22:15:25.284776 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.284749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fzxxr" event={"ID":"85cba916-2b2c-42e7-a6fc-d31e84cc898e","Type":"ContainerStarted","Data":"21c6b87ffea3b746ae2c896b604d4dcd468efcb9ea986c201943602557158e44"} Jul 07 22:15:25.286605 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.286582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" event={"ID":"889125a9-3667-48c9-ba23-5bb0251e3d2c","Type":"ContainerStarted","Data":"8877904f774982e8154263dc7b4dd8979e80bcad95657a46970a293b7f435669"} Jul 07 22:15:25.288464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.288437 2581 generic.go:356] "Generic (PLEG): container finished" podID="721d58d1-2a79-46a6-ab60-cc26a2de15d5" containerID="06a538cbc9bc5160cbd9307a1619283bebcdf36a6c2d21d0da424251ab16fecb" exitCode=0 Jul 07 22:15:25.288583 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.288521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerDied","Data":"06a538cbc9bc5160cbd9307a1619283bebcdf36a6c2d21d0da424251ab16fecb"} Jul 07 22:15:25.296124 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.296100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"7752f6f8c2144340bafd39a990a0a7e814d83fc2afd409ba3d7469eeb5a3e4fe"} Jul 07 22:15:25.296220 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.296205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"0bcaa2ce76da1a9bbb9ed65c5915788feef4f97ae5bdef53381308528d1037c3"} Jul 07 22:15:25.299582 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.299547 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tfhlz" podStartSLOduration=3.603612424 podStartE2EDuration="22.299536156s" totalImagesPullingTime="18.695923732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:25.299326536 +0000 UTC m=+23.758030210" watchObservedRunningTime="2026-07-07 22:15:25.299536156 +0000 UTC m=+23.758239810" Jul 07 22:15:25.314852 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.314814 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jfjcb" podStartSLOduration=3.514350836 podStartE2EDuration="22.314800082s" totalImagesPullingTime="18.800449246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:25.314527727 +0000 UTC m=+23.773231397" watchObservedRunningTime="2026-07-07 22:15:25.314800082 +0000 UTC m=+23.773503737" Jul 07 22:15:25.380537 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.380497 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fzxxr" podStartSLOduration=3.581160497 podStartE2EDuration="22.380484268s" totalImagesPullingTime="18.799323771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:25.380039996 +0000 UTC m=+23.838743670" watchObservedRunningTime="2026-07-07 22:15:25.380484268 +0000 UTC m=+23.839187923" Jul 07 22:15:25.393828 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.393785 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b2jwl" podStartSLOduration=11.981651913 podStartE2EDuration="22.39376955s" totalImagesPullingTime="10.412117637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:25.393533659 +0000 UTC m=+23.852237313" watchObservedRunningTime="2026-07-07 22:15:25.39376955 +0000 UTC m=+23.852473204" Jul 07 22:15:25.407268 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:25.407224 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-szlv7" podStartSLOduration=3.616639523 podStartE2EDuration="22.407208251s" totalImagesPullingTime="18.790568728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:25.406678588 +0000 UTC m=+23.865382264" watchObservedRunningTime="2026-07-07 22:15:25.407208251 +0000 UTC m=+23.865911914" Jul 07 22:15:26.138507 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:26.138477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:26.138683 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:26.138577 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:26.301782 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:26.301695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"f177bbd2fa17d28e89077ae48d95c43b09bed75205546836a5d2e2eb0d1f0394"} Jul 07 22:15:26.302672 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:26.301787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"c2f5f1a660b4a0e2c94c6e136d768ba1709fcacc54eff41d32f4f130bfab7466"} Jul 07 22:15:26.302672 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:26.301833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"c5e4fe36f3318f05271b2fda5708d0238067a18c38a6ab02b99ff1c2c3eaf363"} Jul 07 22:15:26.302672 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:26.301872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"8615aa3170844982bcc3392dd9ac0df7f31f70dce77c59d668a1b017c9365429"} Jul 07 22:15:26.494702 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:26.494677 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 22:15:27.011275 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.011140 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T22:15:26.494694806Z","UUID":"8562658c-3c85-4fbc-9537-0aa722b9d130","Handler":null,"Name":"","Endpoint":""} Jul 07 22:15:27.012975 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.012949 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 22:15:27.013199 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.012999 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 22:15:27.139382 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.139354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:27.139575 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:27.139457 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:27.139575 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.139514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:27.139717 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:27.139593 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:27.160088 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.160055 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:27.160747 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.160718 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:27.306525 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.306433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j2mz8" event={"ID":"6ccaa330-156d-4d8f-b110-a9dd92387a87","Type":"ContainerStarted","Data":"f0fe675e819c63b4c51002dc91df4be7ca4a9dcefe42c8edd4b055ead6a3fd45"} Jul 07 22:15:27.308992 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.308960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" event={"ID":"85d2bc3c-773d-44f8-934e-7386705b63f1","Type":"ContainerStarted","Data":"f216e9fdff37bd16f1e610ede05dd0f4ab11547392d26e98a40dc1b30bdd8dc3"} Jul 07 22:15:27.309318 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.309298 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:27.309912 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.309891 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b2jwl" Jul 07 22:15:27.319936 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:27.319832 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j2mz8" podStartSLOduration=5.606726978 podStartE2EDuration="24.319813523s" totalImagesPullingTime="18.713086545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:27.31973332 +0000 UTC m=+25.778436976" watchObservedRunningTime="2026-07-07 22:15:27.319813523 +0000 UTC m=+25.778517180" Jul 07 22:15:28.139443 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:28.139357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:28.139631 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:28.139479 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:28.317448 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:28.317408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" event={"ID":"85d2bc3c-773d-44f8-934e-7386705b63f1","Type":"ContainerStarted","Data":"6ab606083109b55cff875b9352cc6578c5c497ff3d595bfa46c44575d8f2d3eb"} Jul 07 22:15:28.323304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:28.323276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"c505a7d82149b772a0101ee45621cec7c66e04e3845ccf99c929469ec76f89c5"} Jul 07 22:15:28.335738 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:28.335688 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6t2bz" podStartSLOduration=4.2467452 podStartE2EDuration="25.335671115s" totalImagesPullingTime="21.088925915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:28.335301538 +0000 UTC m=+26.794005212" watchObservedRunningTime="2026-07-07 22:15:28.335671115 +0000 UTC m=+26.794374774" Jul 07 22:15:28.529823 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:28.529741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:28.585242 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:28.585216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:29.018824 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.018591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:29.127506 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.127475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:29.138812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.138788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:29.138943 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:29.138927 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:29.139020 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.139004 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:29.139111 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:29.139092 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:29.307353 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.307267 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:29.410596 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.410544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:29.476764 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:29.476732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:30.139334 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:30.139305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:30.139503 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:30.139426 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:30.260775 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:30.260700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:30.847737 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:30.847697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:30.947829 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:30.947791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:31.139026 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:31.138942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:31.139199 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:31.138942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:31.139199 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:31.139088 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:31.139199 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:31.139148 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:31.143374 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:31.143352 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:32.139273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.139092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:32.139963 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:32.139361 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:32.333405 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.333365 2581 generic.go:356] "Generic (PLEG): container finished" podID="721d58d1-2a79-46a6-ab60-cc26a2de15d5" containerID="d36ab25002d8eb2c14d750411d883ae6d70fa9074ff17979c124dc47d5ec7ef3" exitCode=0 Jul 07 22:15:32.333733 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.333452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerDied","Data":"d36ab25002d8eb2c14d750411d883ae6d70fa9074ff17979c124dc47d5ec7ef3"} Jul 07 22:15:32.336927 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.336902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" event={"ID":"beaabce7-515a-4d2d-bac0-803903527f44","Type":"ContainerStarted","Data":"b499046a5fb960a0a75efa402a98129f9283980e180638298ece02e431b91f86"} Jul 07 22:15:32.337134 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.337122 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:32.337184 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.337176 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:32.337234 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.337212 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:32.352224 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.352200 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:32.352329 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.352301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:15:32.381352 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.379730 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" podStartSLOduration=10.529497896 podStartE2EDuration="29.37971199s" totalImagesPullingTime="18.850214094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:32.378474177 +0000 UTC m=+30.837177824" watchObservedRunningTime="2026-07-07 22:15:32.37971199 +0000 UTC m=+30.838415647" Jul 07 22:15:32.590300 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.590268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:32.649265 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:32.649194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:33.140748 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.140381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:33.140748 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.140496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:33.140748 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:33.140588 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:33.140748 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:33.140600 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:33.392748 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.392648 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tv8b4"] Jul 07 22:15:33.392885 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.392785 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:33.392930 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:33.392892 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:33.397605 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.397580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g25gv"] Jul 07 22:15:33.397734 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.397694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:33.397810 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:33.397787 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:33.398293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.398274 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mjwhp"] Jul 07 22:15:33.398393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:33.398378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:33.398483 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:33.398463 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:34.344071 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:34.343754 2581 generic.go:356] "Generic (PLEG): container finished" podID="721d58d1-2a79-46a6-ab60-cc26a2de15d5" containerID="500093686de5def705d29277f684ae8102f5884d074fd35eb6b9fbcbb720bdf3" exitCode=0 Jul 07 22:15:34.344071 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:34.343801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerDied","Data":"500093686de5def705d29277f684ae8102f5884d074fd35eb6b9fbcbb720bdf3"} Jul 07 22:15:35.139471 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:35.139431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:35.139713 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:35.139542 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:35.139713 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:35.139431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:35.139713 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:35.139637 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:35.139713 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:35.139440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:35.139713 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:35.139691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:36.350523 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:36.350491 2581 generic.go:356] "Generic (PLEG): container finished" podID="721d58d1-2a79-46a6-ab60-cc26a2de15d5" containerID="eecfa4ef0bdeb3d50d98606b639d4bd1e888d3e32f4677d7d00ec7d3614e10b3" exitCode=0 Jul 07 22:15:36.351003 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:36.350552 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerDied","Data":"eecfa4ef0bdeb3d50d98606b639d4bd1e888d3e32f4677d7d00ec7d3614e10b3"} Jul 07 22:15:36.803155 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:36.803123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:36.803326 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:36.803174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:36.803326 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.803275 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:36.803400 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.803328 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs podName:e571d82d-77e7-4924-98f2-60190970855a nodeName:}" failed. No retries permitted until 2026-07-07 22:16:08.803315748 +0000 UTC m=+67.262019381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs") pod "network-metrics-daemon-g25gv" (UID: "e571d82d-77e7-4924-98f2-60190970855a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 22:15:36.803400 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.803275 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:36.803468 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.803405 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret podName:d37e905e-0eca-4b71-8604-0d8e0d47f1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:16:08.803393586 +0000 UTC m=+67.262097223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret") pod "global-pull-secret-syncer-tv8b4" (UID: "d37e905e-0eca-4b71-8604-0d8e0d47f1f7") : object "kube-system"/"original-pull-secret" not registered Jul 07 22:15:36.903812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:36.903778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:36.903991 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.903969 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 22:15:36.904051 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.903996 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 22:15:36.904051 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.904014 2581 projected.go:196] Error preparing data for projected volume kube-api-access-h8wp8 for pod openshift-network-diagnostics/network-check-target-mjwhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:36.904140 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:36.904083 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8 podName:c281e484-7d66-457a-929f-3c0f2d4c54ae nodeName:}" failed. No retries permitted until 2026-07-07 22:16:08.904063798 +0000 UTC m=+67.362767434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8wp8" (UniqueName: "kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8") pod "network-check-target-mjwhp" (UID: "c281e484-7d66-457a-929f-3c0f2d4c54ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 22:15:37.139182 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.139096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:37.139182 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.139165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:37.139406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.139097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:37.139406 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:37.139227 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tv8b4" podUID="d37e905e-0eca-4b71-8604-0d8e0d47f1f7" Jul 07 22:15:37.139406 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:37.139362 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g25gv" podUID="e571d82d-77e7-4924-98f2-60190970855a" Jul 07 22:15:37.139572 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:37.139455 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjwhp" podUID="c281e484-7d66-457a-929f-3c0f2d4c54ae" Jul 07 22:15:37.337919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.337242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:37.394237 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.394154 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:37.693384 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.693261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:37.792311 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.792276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:37.804853 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.804830 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-33.ec2.internal" event="NodeReady" Jul 07 22:15:37.805001 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.804985 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 22:15:37.857890 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.857860 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7c9z8"] Jul 07 22:15:37.859953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.859933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:37.860722 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.860700 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2z5t6"] Jul 07 22:15:37.862456 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.862438 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 22:15:37.862586 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.862439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 22:15:37.862661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.862602 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dxzxn\"" Jul 07 22:15:37.862881 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.862868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:37.864996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.864980 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 22:15:37.865218 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.865201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 22:15:37.865315 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.865299 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlhsn\"" Jul 07 22:15:37.865375 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.865339 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 22:15:37.865414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.865341 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 22:15:37.874659 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.874601 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2z5t6"] Jul 07 22:15:37.875415 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.875395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7c9z8"] Jul 07 22:15:37.877447 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.877427 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sx49m"] Jul 07 22:15:37.879568 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.879550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:37.881883 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.881866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 22:15:37.881956 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.881898 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s2dph\"" Jul 07 22:15:37.882055 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.881996 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 22:15:37.882098 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.882083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 22:15:37.892312 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.892293 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sx49m"] Jul 07 22:15:37.985134 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:37.985056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:38.012785 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wwbc\" (UniqueName: \"kubernetes.io/projected/9f2691d4-465f-4fdb-a4a6-80fbe05bddf0-kube-api-access-2wwbc\") pod \"ingress-canary-sx49m\" (UID: \"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0\") " pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.012917 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddd9897a-cb21-49c7-b82e-929eb2567217-metrics-tls\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.012917 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4276b593-d9ba-48be-954b-d0feb2f25424-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.012917 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7zv\" (UniqueName: \"kubernetes.io/projected/4276b593-d9ba-48be-954b-d0feb2f25424-kube-api-access-5s7zv\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.012917 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddd9897a-cb21-49c7-b82e-929eb2567217-tmp-dir\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.013056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4276b593-d9ba-48be-954b-d0feb2f25424-crio-socket\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.013056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.012989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4276b593-d9ba-48be-954b-d0feb2f25424-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.013056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.013020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddd9897a-cb21-49c7-b82e-929eb2567217-config-volume\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.013056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.013038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h247r\" (UniqueName: \"kubernetes.io/projected/ddd9897a-cb21-49c7-b82e-929eb2567217-kube-api-access-h247r\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.013170 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.013059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f2691d4-465f-4fdb-a4a6-80fbe05bddf0-cert\") pod \"ingress-canary-sx49m\" (UID: \"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0\") " pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.013170 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.013103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4276b593-d9ba-48be-954b-d0feb2f25424-data-volume\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.042201 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.042171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:38.113808 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.113774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wwbc\" (UniqueName: \"kubernetes.io/projected/9f2691d4-465f-4fdb-a4a6-80fbe05bddf0-kube-api-access-2wwbc\") pod \"ingress-canary-sx49m\" (UID: \"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0\") " pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.113808 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.113814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddd9897a-cb21-49c7-b82e-929eb2567217-metrics-tls\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.114041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.113832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4276b593-d9ba-48be-954b-d0feb2f25424-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.113859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7zv\" (UniqueName: \"kubernetes.io/projected/4276b593-d9ba-48be-954b-d0feb2f25424-kube-api-access-5s7zv\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.113881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddd9897a-cb21-49c7-b82e-929eb2567217-tmp-dir\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.114041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.113933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4276b593-d9ba-48be-954b-d0feb2f25424-crio-socket\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4276b593-d9ba-48be-954b-d0feb2f25424-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddd9897a-cb21-49c7-b82e-929eb2567217-config-volume\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.114229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h247r\" (UniqueName: \"kubernetes.io/projected/ddd9897a-cb21-49c7-b82e-929eb2567217-kube-api-access-h247r\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.114229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4276b593-d9ba-48be-954b-d0feb2f25424-crio-socket\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f2691d4-465f-4fdb-a4a6-80fbe05bddf0-cert\") pod \"ingress-canary-sx49m\" (UID: \"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0\") " pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.114229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4276b593-d9ba-48be-954b-d0feb2f25424-data-volume\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114485 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114466 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4276b593-d9ba-48be-954b-d0feb2f25424-data-volume\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114523 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4276b593-d9ba-48be-954b-d0feb2f25424-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.114803 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.114783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddd9897a-cb21-49c7-b82e-929eb2567217-tmp-dir\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.115123 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.115092 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddd9897a-cb21-49c7-b82e-929eb2567217-config-volume\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.117796 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.117776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddd9897a-cb21-49c7-b82e-929eb2567217-metrics-tls\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.117891 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.117780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4276b593-d9ba-48be-954b-d0feb2f25424-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.117931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.117918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f2691d4-465f-4fdb-a4a6-80fbe05bddf0-cert\") pod \"ingress-canary-sx49m\" (UID: \"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0\") " pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.121626 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.121581 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h247r\" (UniqueName: \"kubernetes.io/projected/ddd9897a-cb21-49c7-b82e-929eb2567217-kube-api-access-h247r\") pod \"dns-default-7c9z8\" (UID: \"ddd9897a-cb21-49c7-b82e-929eb2567217\") " pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.121751 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.121728 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7zv\" (UniqueName: \"kubernetes.io/projected/4276b593-d9ba-48be-954b-d0feb2f25424-kube-api-access-5s7zv\") pod \"insights-runtime-extractor-2z5t6\" (UID: \"4276b593-d9ba-48be-954b-d0feb2f25424\") " pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.121857 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.121842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wwbc\" (UniqueName: \"kubernetes.io/projected/9f2691d4-465f-4fdb-a4a6-80fbe05bddf0-kube-api-access-2wwbc\") pod \"ingress-canary-sx49m\" (UID: \"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0\") " pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.170008 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.169969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:38.174799 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.174776 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2z5t6" Jul 07 22:15:38.188676 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.188634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sx49m" Jul 07 22:15:38.345677 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.345374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2z5t6"] Jul 07 22:15:38.349721 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.349693 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sx49m"] Jul 07 22:15:38.352343 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:38.352303 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4276b593_d9ba_48be_954b_d0feb2f25424.slice/crio-d767ae8f8f658344dfeab19fb9925df010c288082c4e89522664ff64e5d9a904 WatchSource:0}: Error finding container d767ae8f8f658344dfeab19fb9925df010c288082c4e89522664ff64e5d9a904: Status 404 returned error can't find the container with id d767ae8f8f658344dfeab19fb9925df010c288082c4e89522664ff64e5d9a904 Jul 07 22:15:38.353552 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:38.353527 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2691d4_465f_4fdb_a4a6_80fbe05bddf0.slice/crio-90a9566b5cf377cf875ea369c69a0b2823401b088d4fe238643cc397c9c7c000 WatchSource:0}: Error finding container 90a9566b5cf377cf875ea369c69a0b2823401b088d4fe238643cc397c9c7c000: Status 404 returned error can't find the container with id 90a9566b5cf377cf875ea369c69a0b2823401b088d4fe238643cc397c9c7c000 Jul 07 22:15:38.357339 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.357279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2z5t6" event={"ID":"4276b593-d9ba-48be-954b-d0feb2f25424","Type":"ContainerStarted","Data":"d767ae8f8f658344dfeab19fb9925df010c288082c4e89522664ff64e5d9a904"} Jul 07 22:15:38.357475 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.357438 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7c9z8"] Jul 07 22:15:38.362978 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:38.362952 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd9897a_cb21_49c7_b82e_929eb2567217.slice/crio-4a2f5b9348f267c6512e32079dfc7b5aa9768471724ad203426b1d773b793c41 WatchSource:0}: Error finding container 4a2f5b9348f267c6512e32079dfc7b5aa9768471724ad203426b1d773b793c41: Status 404 returned error can't find the container with id 4a2f5b9348f267c6512e32079dfc7b5aa9768471724ad203426b1d773b793c41 Jul 07 22:15:38.737442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.737405 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:38.838919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.838883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:38.932374 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.932341 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d65b5659d-dxw7x"] Jul 07 22:15:38.935682 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.934716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:38.937506 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.937335 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 22:15:38.939573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.938446 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 22:15:38.939573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.938719 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 22:15:38.939573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.938911 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z4kb7\"" Jul 07 22:15:38.939573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.939161 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 22:15:38.939573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.939184 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 22:15:38.939573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.939388 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 22:15:38.939931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.939694 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 22:15:38.948842 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.948823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d65b5659d-dxw7x"] Jul 07 22:15:38.950756 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:38.950735 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 22:15:39.022344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-serving-cert\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.022344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-service-ca\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.022569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-config\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.022569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-oauth-config\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.022569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-trusted-ca-bundle\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.022569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-oauth-serving-cert\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.022569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.022517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvrr\" (UniqueName: \"kubernetes.io/projected/e3a652cd-1d9e-4b02-802f-3a3853a494da-kube-api-access-jmvrr\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-config\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-oauth-config\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-trusted-ca-bundle\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-oauth-serving-cert\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvrr\" (UniqueName: \"kubernetes.io/projected/e3a652cd-1d9e-4b02-802f-3a3853a494da-kube-api-access-jmvrr\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-serving-cert\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.123347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.123265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-service-ca\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.124295 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.124265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-service-ca\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.124757 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.124732 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-trusted-ca-bundle\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.124920 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.124899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-oauth-serving-cert\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.125321 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.125303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-config\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.134946 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.134915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-oauth-config\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.135287 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.135264 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-serving-cert\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.137422 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.137399 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvrr\" (UniqueName: \"kubernetes.io/projected/e3a652cd-1d9e-4b02-802f-3a3853a494da-kube-api-access-jmvrr\") pod \"console-5d65b5659d-dxw7x\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.140039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.140020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:15:39.140129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.140021 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:15:39.140529 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.140512 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:15:39.144949 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.144781 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 22:15:39.144949 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.144810 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 22:15:39.145114 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.145100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7fbf\"" Jul 07 22:15:39.145463 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.145315 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkskh\"" Jul 07 22:15:39.145463 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.145355 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 22:15:39.145650 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.145465 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 22:15:39.249806 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.249765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:39.364313 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.364277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sx49m" event={"ID":"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0","Type":"ContainerStarted","Data":"90a9566b5cf377cf875ea369c69a0b2823401b088d4fe238643cc397c9c7c000"} Jul 07 22:15:39.366916 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.366890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7c9z8" event={"ID":"ddd9897a-cb21-49c7-b82e-929eb2567217","Type":"ContainerStarted","Data":"4a2f5b9348f267c6512e32079dfc7b5aa9768471724ad203426b1d773b793c41"} Jul 07 22:15:39.436687 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.436575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d65b5659d-dxw7x"] Jul 07 22:15:39.440804 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:39.440767 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a652cd_1d9e_4b02_802f_3a3853a494da.slice/crio-5950676321c7e42866d4feec30fe10b53f115acf9ef00ca7e334490c36740c74 WatchSource:0}: Error finding container 5950676321c7e42866d4feec30fe10b53f115acf9ef00ca7e334490c36740c74: Status 404 returned error can't find the container with id 5950676321c7e42866d4feec30fe10b53f115acf9ef00ca7e334490c36740c74 Jul 07 22:15:39.530996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:39.530963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:40.372497 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:40.372459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65b5659d-dxw7x" event={"ID":"e3a652cd-1d9e-4b02-802f-3a3853a494da","Type":"ContainerStarted","Data":"5950676321c7e42866d4feec30fe10b53f115acf9ef00ca7e334490c36740c74"} Jul 07 22:15:41.664129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:41.664088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:41.730361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:41.730327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:42.516778 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:42.516749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:43.659877 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.659836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:43.760245 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.760212 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:43.810637 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.810589 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z"] Jul 07 22:15:43.825127 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.825022 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:43.871183 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.871151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z"] Jul 07 22:15:43.871351 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.871250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:43.873376 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.873353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 22:15:43.873490 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.873359 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6xppr\"" Jul 07 22:15:43.968581 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:43.968499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8995z\" (UID: \"f4c03ad0-8219-4413-a6a6-fe5b416e7107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:44.065897 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:44.065856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:44.068965 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:44.068936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8995z\" (UID: \"f4c03ad0-8219-4413-a6a6-fe5b416e7107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:44.069090 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:44.069064 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 22:15:44.069141 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:44.069129 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates podName:f4c03ad0-8219-4413-a6a6-fe5b416e7107 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:44.56910949 +0000 UTC m=+43.027813124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-8995z" (UID: "f4c03ad0-8219-4413-a6a6-fe5b416e7107") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 22:15:44.165929 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:44.165891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:44.574511 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:44.574470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8995z\" (UID: \"f4c03ad0-8219-4413-a6a6-fe5b416e7107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:44.574709 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:44.574646 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 22:15:44.574770 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:44.574728 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates podName:f4c03ad0-8219-4413-a6a6-fe5b416e7107 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:45.574705665 +0000 UTC m=+44.033409322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-8995z" (UID: "f4c03ad0-8219-4413-a6a6-fe5b416e7107") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 22:15:44.764710 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:44.764672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:45.582896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:45.582856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8995z\" (UID: \"f4c03ad0-8219-4413-a6a6-fe5b416e7107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:45.586311 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:45.586284 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4c03ad0-8219-4413-a6a6-fe5b416e7107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8995z\" (UID: \"f4c03ad0-8219-4413-a6a6-fe5b416e7107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:45.683633 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:45.683579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:47.426735 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:47.426704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:48.036713 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.036683 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z"] Jul 07 22:15:48.042717 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:48.042688 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c03ad0_8219_4413_a6a6_fe5b416e7107.slice/crio-59625237e72259e6854d1c6503487c52d41a927aa5fe4cd600784585fe63199e WatchSource:0}: Error finding container 59625237e72259e6854d1c6503487c52d41a927aa5fe4cd600784585fe63199e: Status 404 returned error can't find the container with id 59625237e72259e6854d1c6503487c52d41a927aa5fe4cd600784585fe63199e Jul 07 22:15:48.395826 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.395786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sx49m" event={"ID":"9f2691d4-465f-4fdb-a4a6-80fbe05bddf0","Type":"ContainerStarted","Data":"ee5391e52e7975cbd00bcda8c638f42eb7c2df43040cf4fa4d26bcbe8e69afdf"} Jul 07 22:15:48.397314 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.397289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" event={"ID":"f4c03ad0-8219-4413-a6a6-fe5b416e7107","Type":"ContainerStarted","Data":"59625237e72259e6854d1c6503487c52d41a927aa5fe4cd600784585fe63199e"} Jul 07 22:15:48.399154 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.399123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2z5t6" event={"ID":"4276b593-d9ba-48be-954b-d0feb2f25424","Type":"ContainerStarted","Data":"d2c5febecf80800fa5297ef54be9c11eff78b0f07a5e265e8c901333f99d0776"} Jul 07 22:15:48.403053 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.402410 2581 generic.go:356] "Generic (PLEG): container finished" podID="721d58d1-2a79-46a6-ab60-cc26a2de15d5" containerID="732be3e7212cbc12fd698b27cc18f4ae5c57dfe8dc5743dcc214b88b1d935a28" exitCode=0 Jul 07 22:15:48.403053 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.402515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerDied","Data":"732be3e7212cbc12fd698b27cc18f4ae5c57dfe8dc5743dcc214b88b1d935a28"} Jul 07 22:15:48.404746 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.404711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7c9z8" event={"ID":"ddd9897a-cb21-49c7-b82e-929eb2567217","Type":"ContainerStarted","Data":"ad526790988cae39728468cdf065c9585704fb91f2445de46e050ba14ccee777"} Jul 07 22:15:48.404857 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.404758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7c9z8" event={"ID":"ddd9897a-cb21-49c7-b82e-929eb2567217","Type":"ContainerStarted","Data":"fafa89c595b95cf6254a256236051463e8f50a8bfed50cd61ce0c44253911005"} Jul 07 22:15:48.406876 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.406850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65b5659d-dxw7x" event={"ID":"e3a652cd-1d9e-4b02-802f-3a3853a494da","Type":"ContainerStarted","Data":"3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77"} Jul 07 22:15:48.411364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.411318 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sx49m" podStartSLOduration=1.869306331 podStartE2EDuration="11.411300735s" totalImagesPullingTime="9.541994404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:48.410504808 +0000 UTC m=+46.869208464" watchObservedRunningTime="2026-07-07 22:15:48.411300735 +0000 UTC m=+46.870004390" Jul 07 22:15:48.446862 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:48.446783 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d65b5659d-dxw7x" podStartSLOduration=1.9835016030000001 podStartE2EDuration="10.446765012s" totalImagesPullingTime="8.463263409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:48.445749852 +0000 UTC m=+46.904453521" watchObservedRunningTime="2026-07-07 22:15:48.446765012 +0000 UTC m=+46.905468646" Jul 07 22:15:49.251146 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.251111 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:49.251343 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.251168 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:49.252710 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.252679 2581 patch_prober.go:28] interesting pod/console-5d65b5659d-dxw7x container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 07 22:15:49.252822 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.252732 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d65b5659d-dxw7x" podUID="e3a652cd-1d9e-4b02-802f-3a3853a494da" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 07 22:15:49.384505 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.384457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:49.414658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.414603 2581 generic.go:356] "Generic (PLEG): container finished" podID="721d58d1-2a79-46a6-ab60-cc26a2de15d5" containerID="226697d1242bd593cc9ef9aaf30cd91e512be9e73cdd33713fb7ee6a451c8645" exitCode=0 Jul 07 22:15:49.414658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.414647 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerDied","Data":"226697d1242bd593cc9ef9aaf30cd91e512be9e73cdd33713fb7ee6a451c8645"} Jul 07 22:15:49.415343 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.415317 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7c9z8" Jul 07 22:15:49.432395 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.432345 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7c9z8" podStartSLOduration=2.899440985 podStartE2EDuration="12.432329363s" totalImagesPullingTime="9.532888378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:49.431279722 +0000 UTC m=+47.889983414" watchObservedRunningTime="2026-07-07 22:15:49.432329363 +0000 UTC m=+47.891032996" Jul 07 22:15:49.440433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:49.440367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:50.420672 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:50.420648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" event={"ID":"721d58d1-2a79-46a6-ab60-cc26a2de15d5","Type":"ContainerStarted","Data":"44f50a97691168d7ba2aefda7ca7ceabd49b61452efdf2f7eafe460850c34f71"} Jul 07 22:15:50.440851 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:50.440816 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qjtmk" podStartSLOduration=16.986481195 podStartE2EDuration="47.440801054s" totalImagesPullingTime="30.454319859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:50.439596703 +0000 UTC m=+48.898300369" watchObservedRunningTime="2026-07-07 22:15:50.440801054 +0000 UTC m=+48.899504741" Jul 07 22:15:50.562378 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:50.562337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:50.611410 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:50.611337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:50.859497 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:50.859467 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:50.913349 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:50.913275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:51.428013 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.427793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" event={"ID":"f4c03ad0-8219-4413-a6a6-fe5b416e7107","Type":"ContainerStarted","Data":"a2f6ac007a3f7f58a66ce7b18002e26d90c09b40ceabd14ec3f44dad471383ff"} Jul 07 22:15:51.428510 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.428162 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:51.430734 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.430703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2z5t6" event={"ID":"4276b593-d9ba-48be-954b-d0feb2f25424","Type":"ContainerStarted","Data":"de5d59488300c0e11a7917db91a96c409ad8ec00b39de249eb9632c92408df1c"} Jul 07 22:15:51.433843 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.433820 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" Jul 07 22:15:51.443727 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.443692 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8995z" podStartSLOduration=6.133793148 podStartE2EDuration="8.443674985s" totalImagesPullingTime="2.309881837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:51.443451866 +0000 UTC m=+49.902155543" watchObservedRunningTime="2026-07-07 22:15:51.443674985 +0000 UTC m=+49.902378707" Jul 07 22:15:51.837476 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.837442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:51.912448 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:51.912423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:52.262527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:52.262499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:53.439548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:53.439523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2z5t6" event={"ID":"4276b593-d9ba-48be-954b-d0feb2f25424","Type":"ContainerStarted","Data":"c04e7af9bb23952e834cd91e98e12174d71b6ee4a193f7c2687cbcf627099075"} Jul 07 22:15:53.457606 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:53.457567 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2z5t6" podStartSLOduration=1.740351021 podStartE2EDuration="16.45755494s" totalImagesPullingTime="14.717203919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:53.457000577 +0000 UTC m=+51.915704233" watchObservedRunningTime="2026-07-07 22:15:53.45755494 +0000 UTC m=+51.916258595" Jul 07 22:15:55.379586 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:55.379555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:57.169807 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:57.169770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:57.270317 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:57.270281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:57.979063 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:57.979023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.185692 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.185656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.201696 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.201665 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2"] Jul 07 22:15:58.204184 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.204156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.206741 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.206716 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 22:15:58.206741 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.206729 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 22:15:58.206935 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.206748 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 22:15:58.207495 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.207478 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vbvld\"" Jul 07 22:15:58.207604 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.207497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 22:15:58.207604 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.207574 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 22:15:58.218929 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.218907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2"] Jul 07 22:15:58.256448 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.256416 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh"] Jul 07 22:15:58.258547 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.258528 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.260982 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.260963 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 22:15:58.261113 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.261068 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-62szb\"" Jul 07 22:15:58.261378 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.261357 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 22:15:58.261658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.261641 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 22:15:58.272257 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.272233 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh"] Jul 07 22:15:58.275770 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.275738 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dchl4"] Jul 07 22:15:58.276003 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.275978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.276093 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9czm\" (UniqueName: \"kubernetes.io/projected/91891956-0904-4d37-be0a-0f46d6ab3051-kube-api-access-v9czm\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.276137 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276104 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de5d9495-9f96-4c9f-9046-6e0dc0b74832-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.276171 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.276217 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.276267 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91891956-0904-4d37-be0a-0f46d6ab3051-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.276319 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.276371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/91891956-0904-4d37-be0a-0f46d6ab3051-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.276424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.276475 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.276432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwmn\" (UniqueName: \"kubernetes.io/projected/de5d9495-9f96-4c9f-9046-6e0dc0b74832-kube-api-access-nmwmn\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.277803 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.277791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.279969 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.279952 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 22:15:58.279969 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.279967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w7tnb\"" Jul 07 22:15:58.280138 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.280059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 22:15:58.280234 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.280222 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 22:15:58.281848 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.281824 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.357162 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.357125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.377460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwmn\" (UniqueName: \"kubernetes.io/projected/de5d9495-9f96-4c9f-9046-6e0dc0b74832-kube-api-access-nmwmn\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.377460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.377812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9czm\" (UniqueName: \"kubernetes.io/projected/91891956-0904-4d37-be0a-0f46d6ab3051-kube-api-access-v9czm\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.377812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-wtmp\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.377812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-metrics-client-ca\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.377812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de5d9495-9f96-4c9f-9046-6e0dc0b74832-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.377812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.378056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-tls\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.378056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.377978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-root\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91891956-0904-4d37-be0a-0f46d6ab3051-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.378056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.378056 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:58.378045 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:58.378112 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-tls podName:de5d9495-9f96-4c9f-9046-6e0dc0b74832 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:58.87809486 +0000 UTC m=+57.336798496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-zgsx2" (UID: "de5d9495-9f96-4c9f-9046-6e0dc0b74832") : secret "openshift-state-metrics-tls" not found Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/91891956-0904-4d37-be0a-0f46d6ab3051-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-textfile\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-sys\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wl6\" (UniqueName: \"kubernetes.io/projected/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-kube-api-access-c4wl6\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.378835 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:58.378373 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 22:15:58.378835 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:15:58.378416 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-tls podName:91891956-0904-4d37-be0a-0f46d6ab3051 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:58.878401391 +0000 UTC m=+57.337105029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-kfdsh" (UID: "91891956-0904-4d37-be0a-0f46d6ab3051") : secret "kube-state-metrics-tls" not found Jul 07 22:15:58.378835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de5d9495-9f96-4c9f-9046-6e0dc0b74832-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.378835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/91891956-0904-4d37-be0a-0f46d6ab3051-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.378835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.378722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91891956-0904-4d37-be0a-0f46d6ab3051-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.379137 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.379094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.380095 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.380074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.380304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.380288 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.384987 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.384965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwmn\" (UniqueName: \"kubernetes.io/projected/de5d9495-9f96-4c9f-9046-6e0dc0b74832-kube-api-access-nmwmn\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.385656 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.385639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9czm\" (UniqueName: \"kubernetes.io/projected/91891956-0904-4d37-be0a-0f46d6ab3051-kube-api-access-v9czm\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.458177 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.458143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.479412 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-tls\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-root\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-textfile\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-sys\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wl6\" (UniqueName: \"kubernetes.io/projected/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-kube-api-access-c4wl6\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-wtmp\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-metrics-client-ca\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479595 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-root\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-sys\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.479919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-wtmp\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.480136 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.479937 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-textfile\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.480195 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.480176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.480239 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.480230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-metrics-client-ca\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.481773 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.481753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.481846 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.481835 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-node-exporter-tls\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.487896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.487872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wl6\" (UniqueName: \"kubernetes.io/projected/ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d-kube-api-access-c4wl6\") pod \"node-exporter-dchl4\" (UID: \"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d\") " pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.558571 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.558479 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.586882 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.586852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dchl4" Jul 07 22:15:58.596570 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:58.596545 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6ebd48_c137_4a6f_9c5f_b4d20f59ad6d.slice/crio-5fd66692cc01de13b30f5db50edda809e145bf2cb846171d4508bc14d0a3fd45 WatchSource:0}: Error finding container 5fd66692cc01de13b30f5db50edda809e145bf2cb846171d4508bc14d0a3fd45: Status 404 returned error can't find the container with id 5fd66692cc01de13b30f5db50edda809e145bf2cb846171d4508bc14d0a3fd45 Jul 07 22:15:58.657818 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.657780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.882266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.882178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.882266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.882256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.884708 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.884685 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91891956-0904-4d37-be0a-0f46d6ab3051-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kfdsh\" (UID: \"91891956-0904-4d37-be0a-0f46d6ab3051\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:58.884799 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.884690 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de5d9495-9f96-4c9f-9046-6e0dc0b74832-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zgsx2\" (UID: \"de5d9495-9f96-4c9f-9046-6e0dc0b74832\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:58.893464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.893440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:58.994587 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:58.994555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:59.113096 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.113057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" Jul 07 22:15:59.167935 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.167893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" Jul 07 22:15:59.249593 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.249564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2"] Jul 07 22:15:59.256641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.256602 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:59.257793 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:15:59.257760 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5d9495_9f96_4c9f_9046_6e0dc0b74832.slice/crio-551c9713316649699a2add8ca4e3ed9be934d31aeec7da8ad0e0a8dba276d4d1 WatchSource:0}: Error finding container 551c9713316649699a2add8ca4e3ed9be934d31aeec7da8ad0e0a8dba276d4d1: Status 404 returned error can't find the container with id 551c9713316649699a2add8ca4e3ed9be934d31aeec7da8ad0e0a8dba276d4d1 Jul 07 22:15:59.262227 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.262204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:15:59.327563 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.327538 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh"] Jul 07 22:15:59.438104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.438026 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:59.460324 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.460293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" event={"ID":"de5d9495-9f96-4c9f-9046-6e0dc0b74832","Type":"ContainerStarted","Data":"55a38027208e335b2605fdc3ad8b07d1893246bdea35ec8ee606fd3bc25f8a51"} Jul 07 22:15:59.460497 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.460360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" event={"ID":"de5d9495-9f96-4c9f-9046-6e0dc0b74832","Type":"ContainerStarted","Data":"c69fcc1f0e9413de4bba5c6b775c2a57d99e643ac3bd38bab1f800e8f79e66b6"} Jul 07 22:15:59.460497 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.460386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" event={"ID":"de5d9495-9f96-4c9f-9046-6e0dc0b74832","Type":"ContainerStarted","Data":"551c9713316649699a2add8ca4e3ed9be934d31aeec7da8ad0e0a8dba276d4d1"} Jul 07 22:15:59.461811 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.461746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" event={"ID":"91891956-0904-4d37-be0a-0f46d6ab3051","Type":"ContainerStarted","Data":"8f15fd7089d7e6ca27a76ec351d2a9cd54efc7b2372529e230b108b35ea40eff"} Jul 07 22:15:59.463008 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.462982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dchl4" event={"ID":"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d","Type":"ContainerStarted","Data":"5fd66692cc01de13b30f5db50edda809e145bf2cb846171d4508bc14d0a3fd45"} Jul 07 22:15:59.540426 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.540377 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:59.638146 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.638112 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:15:59.903676 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:15:59.903645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:00.212190 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.212158 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw"] Jul 07 22:16:00.214781 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.214756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.217704 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.217682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 22:16:00.217874 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.217682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 22:16:00.217938 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.217851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 22:16:00.218147 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.218125 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d49u5uqi81447\"" Jul 07 22:16:00.218297 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.218129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 22:16:00.218485 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.218462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8ndvz\"" Jul 07 22:16:00.218577 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.218462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 22:16:00.225785 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.225760 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw"] Jul 07 22:16:00.293940 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.293898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.293962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.294009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-grpc-tls\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.294033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa81f32a-cdd8-43cf-8a75-481db982bcb6-metrics-client-ca\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.294119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.294209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-tls\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.294240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.294454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.294290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gffdb\" (UniqueName: \"kubernetes.io/projected/aa81f32a-cdd8-43cf-8a75-481db982bcb6-kube-api-access-gffdb\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395150 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-tls\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395150 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395343 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gffdb\" (UniqueName: \"kubernetes.io/projected/aa81f32a-cdd8-43cf-8a75-481db982bcb6-kube-api-access-gffdb\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395343 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395411 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395411 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-grpc-tls\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395503 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa81f32a-cdd8-43cf-8a75-481db982bcb6-metrics-client-ca\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.395503 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.395458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.396273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.396212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa81f32a-cdd8-43cf-8a75-481db982bcb6-metrics-client-ca\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.398527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.398266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.398527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.398427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-grpc-tls\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.398527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.398470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.398527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.398474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-tls\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.398527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.398519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.398834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.398814 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa81f32a-cdd8-43cf-8a75-481db982bcb6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.403143 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.403123 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gffdb\" (UniqueName: \"kubernetes.io/projected/aa81f32a-cdd8-43cf-8a75-481db982bcb6-kube-api-access-gffdb\") pod \"thanos-querier-7c9d6dc6bc-7kptw\" (UID: \"aa81f32a-cdd8-43cf-8a75-481db982bcb6\") " pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:00.433993 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.433961 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7c9z8" Jul 07 22:16:00.469518 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.469436 2581 generic.go:356] "Generic (PLEG): container finished" podID="ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d" containerID="71cb7f157ef6f2a72b944261677821fb7718dfae7c431cfe5107bb8ca59a477d" exitCode=0 Jul 07 22:16:00.469518 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.469506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dchl4" event={"ID":"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d","Type":"ContainerDied","Data":"71cb7f157ef6f2a72b944261677821fb7718dfae7c431cfe5107bb8ca59a477d"} Jul 07 22:16:00.527138 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:00.527101 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:01.151350 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.151319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:01.173004 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.172712 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw"] Jul 07 22:16:01.176534 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:16:01.176467 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa81f32a_cdd8_43cf_8a75_481db982bcb6.slice/crio-b4a097bac2d920600971a6ed09dcc618a32726e6ce4999fb4de502fe96207f20 WatchSource:0}: Error finding container b4a097bac2d920600971a6ed09dcc618a32726e6ce4999fb4de502fe96207f20: Status 404 returned error can't find the container with id b4a097bac2d920600971a6ed09dcc618a32726e6ce4999fb4de502fe96207f20 Jul 07 22:16:01.254273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.254247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:01.476047 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.475943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" event={"ID":"de5d9495-9f96-4c9f-9046-6e0dc0b74832","Type":"ContainerStarted","Data":"f0a7c689a7f52e6a54f707b7801145643f13daff554638e69f7d75cd4b443bff"} Jul 07 22:16:01.476994 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.476969 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:01.478273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.478243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" event={"ID":"91891956-0904-4d37-be0a-0f46d6ab3051","Type":"ContainerStarted","Data":"6a253436dc1d7ea5ebba796984cde1d2a3d816941ee09cd7dc07703994f3dd6f"} Jul 07 22:16:01.478389 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.478294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" event={"ID":"91891956-0904-4d37-be0a-0f46d6ab3051","Type":"ContainerStarted","Data":"da81a9a6077e0bce022daef415d2ea70622e48667f178d4ae77994c9a655ca1f"} Jul 07 22:16:01.478389 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.478324 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" event={"ID":"91891956-0904-4d37-be0a-0f46d6ab3051","Type":"ContainerStarted","Data":"c3d10e1df6257006a4fea96f72d11de7a36e911302b928f55e5a9384c7ccc1a7"} Jul 07 22:16:01.480828 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.480805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dchl4" event={"ID":"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d","Type":"ContainerStarted","Data":"0b14199d39a536a195ab7b98a538197f0b11ac8639199f0421a750b225bb2907"} Jul 07 22:16:01.480937 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.480857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dchl4" event={"ID":"ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d","Type":"ContainerStarted","Data":"173c9c8ea23adebcdfc3f3da8f897ee5a0658eb8812b0940fee74d1062203ab1"} Jul 07 22:16:01.481992 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.481973 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"b4a097bac2d920600971a6ed09dcc618a32726e6ce4999fb4de502fe96207f20"} Jul 07 22:16:01.491633 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.491568 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zgsx2" podStartSLOduration=1.8636757309999998 podStartE2EDuration="3.491548522s" totalImagesPullingTime="1.627872791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:01.491203132 +0000 UTC m=+59.949906812" watchObservedRunningTime="2026-07-07 22:16:01.491548522 +0000 UTC m=+59.950252178" Jul 07 22:16:01.510640 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.508496 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kfdsh" podStartSLOduration=1.828487168 podStartE2EDuration="3.508477424s" totalImagesPullingTime="1.679990256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:01.507310473 +0000 UTC m=+59.966014129" watchObservedRunningTime="2026-07-07 22:16:01.508477424 +0000 UTC m=+59.967181080" Jul 07 22:16:01.529186 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:01.529131 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dchl4" podStartSLOduration=2.32418253 podStartE2EDuration="3.529114982s" totalImagesPullingTime="1.138464398s" totalInitContainerRuntime="66.468054ms" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:01.528960549 +0000 UTC m=+59.987664264" watchObservedRunningTime="2026-07-07 22:16:01.529114982 +0000 UTC m=+59.987818640" Jul 07 22:16:02.011738 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:02.011701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:02.489019 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:02.488990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:02.578177 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:02.578146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:03.029489 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.029449 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bbc4ccbff-t49h8"] Jul 07 22:16:03.043725 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.043679 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:03.059491 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.059446 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbc4ccbff-t49h8"] Jul 07 22:16:03.059665 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.059562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.119815 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-service-ca\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.119815 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-trusted-ca-bundle\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.120084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-config\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.120084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-oauth-serving-cert\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.120084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-serving-cert\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.120084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt5z8\" (UniqueName: \"kubernetes.io/projected/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-kube-api-access-tt5z8\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.120084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.119996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-oauth-config\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.138559 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.138517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:03.221095 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-service-ca\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221095 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-trusted-ca-bundle\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221306 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-config\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221306 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-oauth-serving-cert\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221306 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-serving-cert\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221445 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt5z8\" (UniqueName: \"kubernetes.io/projected/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-kube-api-access-tt5z8\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221494 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-oauth-config\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.221928 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.221905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-service-ca\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.222429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.222400 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-config\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.222645 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.222626 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-trusted-ca-bundle\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.222645 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.222636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-oauth-serving-cert\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.224280 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.224258 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-oauth-config\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.224664 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.224646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-serving-cert\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.229283 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.229254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt5z8\" (UniqueName: \"kubernetes.io/projected/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-kube-api-access-tt5z8\") pod \"console-6bbc4ccbff-t49h8\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.350533 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.350450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:03.370497 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.370459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:03.554381 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.554351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:03.659375 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.659348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:03.685724 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:03.685594 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbc4ccbff-t49h8"] Jul 07 22:16:03.689754 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:16:03.689732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6d2dfd_1ddf_4e5b_8542_75622770a94c.slice/crio-4e826a8bd74912fcc0add14224fc6bf0f038879999c3827f02c0d9c27964499c WatchSource:0}: Error finding container 4e826a8bd74912fcc0add14224fc6bf0f038879999c3827f02c0d9c27964499c: Status 404 returned error can't find the container with id 4e826a8bd74912fcc0add14224fc6bf0f038879999c3827f02c0d9c27964499c Jul 07 22:16:04.361845 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.361819 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmj9r" Jul 07 22:16:04.445477 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.445445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:04.494435 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.494397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbc4ccbff-t49h8" event={"ID":"ea6d2dfd-1ddf-4e5b-8542-75622770a94c","Type":"ContainerStarted","Data":"ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19"} Jul 07 22:16:04.494642 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.494456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbc4ccbff-t49h8" event={"ID":"ea6d2dfd-1ddf-4e5b-8542-75622770a94c","Type":"ContainerStarted","Data":"4e826a8bd74912fcc0add14224fc6bf0f038879999c3827f02c0d9c27964499c"} Jul 07 22:16:04.496704 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.496676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"784b944a5c151be7290e8b8ea29788f6cdd876a619ae6d838be74c5dd197781a"} Jul 07 22:16:04.496800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.496729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"31eeda6d71a78e2f36b1cd7432d7934ca2f0ef35cb2bb3e4b4b3c1c0cc4c8485"} Jul 07 22:16:04.496800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.496756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"7741b089cb2ae1cb345458b7eeef928f1d61050ff793b1b129daccee733c1ed1"} Jul 07 22:16:04.524624 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.524566 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bbc4ccbff-t49h8" podStartSLOduration=1.5245515649999999 podStartE2EDuration="1.524551565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:04.523715761 +0000 UTC m=+62.982419416" watchObservedRunningTime="2026-07-07 22:16:04.524551565 +0000 UTC m=+62.983255220" Jul 07 22:16:04.542855 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.542821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:04.655255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.655170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:04.755129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:04.755098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:05.503074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:05.503039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"b4c28d698cc7f0cdc8e4f0554299fb58723a0993ce28524c3d54de0b5b92ca75"} Jul 07 22:16:05.503218 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:05.503105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"3b755b8a7c592cdf4127bceb8183158d2eaf0979ec3ea57f87e2226b6c83be67"} Jul 07 22:16:05.503218 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:05.503131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" event={"ID":"aa81f32a-cdd8-43cf-8a75-481db982bcb6","Type":"ContainerStarted","Data":"72d41e3b6ace47f7d3e33a80c3ccf3df381696ed6cd59a1d3bb77554f9dc4278"} Jul 07 22:16:05.523328 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:05.523276 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" podStartSLOduration=2.215319373 podStartE2EDuration="5.523256317s" totalImagesPullingTime="3.307936944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:16:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:05.522297814 +0000 UTC m=+63.981001493" watchObservedRunningTime="2026-07-07 22:16:05.523256317 +0000 UTC m=+63.981959973" Jul 07 22:16:06.506331 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:06.506300 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:07.989827 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:07.989791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:08.091097 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.091059 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:08.869862 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.869823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:16:08.870073 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.869878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:16:08.872597 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.872579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 22:16:08.873218 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.873203 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 22:16:08.882369 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.882336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e571d82d-77e7-4924-98f2-60190970855a-metrics-certs\") pod \"network-metrics-daemon-g25gv\" (UID: \"e571d82d-77e7-4924-98f2-60190970855a\") " pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:16:08.882487 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.882370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d37e905e-0eca-4b71-8604-0d8e0d47f1f7-original-pull-secret\") pod \"global-pull-secret-syncer-tv8b4\" (UID: \"d37e905e-0eca-4b71-8604-0d8e0d47f1f7\") " pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:16:08.971054 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.971017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:16:08.973448 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.973429 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 22:16:08.984375 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.984354 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 22:16:08.995440 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:08.995416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8wp8\" (UniqueName: \"kubernetes.io/projected/c281e484-7d66-457a-929f-3c0f2d4c54ae-kube-api-access-h8wp8\") pod \"network-check-target-mjwhp\" (UID: \"c281e484-7d66-457a-929f-3c0f2d4c54ae\") " pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:16:09.165800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.165724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tv8b4" Jul 07 22:16:09.179402 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.179375 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkskh\"" Jul 07 22:16:09.187171 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.187149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g25gv" Jul 07 22:16:09.187469 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.187446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7fbf\"" Jul 07 22:16:09.195406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.195383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:16:09.331561 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.331400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tv8b4"] Jul 07 22:16:09.335468 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:16:09.335423 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37e905e_0eca_4b71_8604_0d8e0d47f1f7.slice/crio-4c5596c56092b0782520c1882f51d6203845a3ac4e8bb6e75ef770cee41d4e82 WatchSource:0}: Error finding container 4c5596c56092b0782520c1882f51d6203845a3ac4e8bb6e75ef770cee41d4e82: Status 404 returned error can't find the container with id 4c5596c56092b0782520c1882f51d6203845a3ac4e8bb6e75ef770cee41d4e82 Jul 07 22:16:09.357452 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.357425 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g25gv"] Jul 07 22:16:09.359533 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:16:09.359507 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode571d82d_77e7_4924_98f2_60190970855a.slice/crio-3f586220f5155f10ca5bbe7df77ac95802193184ebf087babd64aab3cd2741ba WatchSource:0}: Error finding container 3f586220f5155f10ca5bbe7df77ac95802193184ebf087babd64aab3cd2741ba: Status 404 returned error can't find the container with id 3f586220f5155f10ca5bbe7df77ac95802193184ebf087babd64aab3cd2741ba Jul 07 22:16:09.377514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.377489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mjwhp"] Jul 07 22:16:09.381153 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:16:09.381124 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc281e484_7d66_457a_929f_3c0f2d4c54ae.slice/crio-cc336c179b143230c5557ad1bf6c2c3372d1cb4a2e6362ecafdd71ad7b306219 WatchSource:0}: Error finding container cc336c179b143230c5557ad1bf6c2c3372d1cb4a2e6362ecafdd71ad7b306219: Status 404 returned error can't find the container with id cc336c179b143230c5557ad1bf6c2c3372d1cb4a2e6362ecafdd71ad7b306219 Jul 07 22:16:09.517536 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.517500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mjwhp" event={"ID":"c281e484-7d66-457a-929f-3c0f2d4c54ae","Type":"ContainerStarted","Data":"cc336c179b143230c5557ad1bf6c2c3372d1cb4a2e6362ecafdd71ad7b306219"} Jul 07 22:16:09.518700 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.518677 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g25gv" event={"ID":"e571d82d-77e7-4924-98f2-60190970855a","Type":"ContainerStarted","Data":"3f586220f5155f10ca5bbe7df77ac95802193184ebf087babd64aab3cd2741ba"} Jul 07 22:16:09.519888 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:09.519865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tv8b4" event={"ID":"d37e905e-0eca-4b71-8604-0d8e0d47f1f7","Type":"ContainerStarted","Data":"4c5596c56092b0782520c1882f51d6203845a3ac4e8bb6e75ef770cee41d4e82"} Jul 07 22:16:11.532586 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:11.532545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g25gv" event={"ID":"e571d82d-77e7-4924-98f2-60190970855a","Type":"ContainerStarted","Data":"22e4a03dc7a5a8cdf4f737b2f7c829972aa8e5477627505e536a61825066b8fe"} Jul 07 22:16:11.533048 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:11.532628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g25gv" event={"ID":"e571d82d-77e7-4924-98f2-60190970855a","Type":"ContainerStarted","Data":"41e5296015606c3509e9a88f96ebfd0b594a82e5d76ff95a078761fd763cf00c"} Jul 07 22:16:11.549877 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:11.549822 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g25gv" podStartSLOduration=67.266287965 podStartE2EDuration="1m8.549804343s" totalImagesPullingTime="1.283516378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:11.549797831 +0000 UTC m=+70.008501507" watchObservedRunningTime="2026-07-07 22:16:11.549804343 +0000 UTC m=+70.008508011" Jul 07 22:16:11.683155 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:11.683115 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:11.779900 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:11.779857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:11.999257 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:11.999225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:12.485889 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:12.485827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:12.516470 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:12.516444 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c9d6dc6bc-7kptw" Jul 07 22:16:12.550530 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:12.550489 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:13.371270 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.371242 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:13.371484 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.371315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:13.376833 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.376810 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:13.547694 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.547661 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:16:13.593173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.593139 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d65b5659d-dxw7x"] Jul 07 22:16:13.768414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.768352 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:13.868573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:13.868539 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:14.548514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:14.548469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mjwhp" event={"ID":"c281e484-7d66-457a-929f-3c0f2d4c54ae","Type":"ContainerStarted","Data":"70aa95e32b6e89b528689de2b93d194dcbeb69e2f29648df57037e9bdd772a51"} Jul 07 22:16:14.548719 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:14.548632 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:16:14.549996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:14.549972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tv8b4" event={"ID":"d37e905e-0eca-4b71-8604-0d8e0d47f1f7","Type":"ContainerStarted","Data":"004db4a7e77c9cfce7a6e44e5ced3958e4d67c903b52c6273ee77221f8e8d33a"} Jul 07 22:16:14.564102 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:14.564060 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mjwhp" podStartSLOduration=66.5693243 podStartE2EDuration="1m11.564046502s" totalImagesPullingTime="4.994722202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:14.563677381 +0000 UTC m=+73.022381037" watchObservedRunningTime="2026-07-07 22:16:14.564046502 +0000 UTC m=+73.022750157" Jul 07 22:16:14.579345 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:14.579293 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tv8b4" podStartSLOduration=66.534393603 podStartE2EDuration="1m11.579274081s" totalImagesPullingTime="5.044880478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:14.578413492 +0000 UTC m=+73.037117158" watchObservedRunningTime="2026-07-07 22:16:14.579274081 +0000 UTC m=+73.037977739" Jul 07 22:16:20.881883 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:20.881846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:20.932168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:20.932135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:22.633721 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:22.633693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sx49m_9f2691d4-465f-4fdb-a4a6-80fbe05bddf0/serve-healthcheck-canary/0.log" Jul 07 22:16:35.862362 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:35.862318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:35.962347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:35.962311 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:38.617800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:38.617760 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d65b5659d-dxw7x" podUID="e3a652cd-1d9e-4b02-802f-3a3853a494da" containerName="console" containerID="cri-o://3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77" gracePeriod=15 Jul 07 22:16:38.856096 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:38.856069 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:16:39.009041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009010 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-oauth-config\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009222 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009053 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmvrr\" (UniqueName: \"kubernetes.io/projected/e3a652cd-1d9e-4b02-802f-3a3853a494da-kube-api-access-jmvrr\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009222 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-oauth-serving-cert\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009222 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009121 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-service-ca\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009222 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009162 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-serving-cert\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009222 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009208 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-trusted-ca-bundle\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009476 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009236 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-config\") pod \"e3a652cd-1d9e-4b02-802f-3a3853a494da\" (UID: \"e3a652cd-1d9e-4b02-802f-3a3853a494da\") " Jul 07 22:16:39.009567 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009534 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:16:39.009687 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009661 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:16:39.009687 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009672 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:16:39.009772 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.009684 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-config" (OuterVolumeSpecName: "console-config") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:16:39.011414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.011390 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:16:39.011504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.011479 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:16:39.011541 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.011507 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a652cd-1d9e-4b02-802f-3a3853a494da-kube-api-access-jmvrr" (OuterVolumeSpecName: "kube-api-access-jmvrr") pod "e3a652cd-1d9e-4b02-802f-3a3853a494da" (UID: "e3a652cd-1d9e-4b02-802f-3a3853a494da"). InnerVolumeSpecName "kube-api-access-jmvrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:16:39.110255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110217 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-oauth-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.110255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110247 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-service-ca\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.110255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110256 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.110255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110264 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-trusted-ca-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.110509 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110273 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.110509 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110281 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a652cd-1d9e-4b02-802f-3a3853a494da-console-oauth-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.110509 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.110288 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmvrr\" (UniqueName: \"kubernetes.io/projected/e3a652cd-1d9e-4b02-802f-3a3853a494da-kube-api-access-jmvrr\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:16:39.658408 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.658372 2581 generic.go:356] "Generic (PLEG): container finished" podID="e3a652cd-1d9e-4b02-802f-3a3853a494da" containerID="3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77" exitCode=0 Jul 07 22:16:39.658879 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.658416 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65b5659d-dxw7x" Jul 07 22:16:39.658879 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.658459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65b5659d-dxw7x" event={"ID":"e3a652cd-1d9e-4b02-802f-3a3853a494da","Type":"ContainerDied","Data":"3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77"} Jul 07 22:16:39.658879 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.658516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65b5659d-dxw7x" event={"ID":"e3a652cd-1d9e-4b02-802f-3a3853a494da","Type":"ContainerDied","Data":"5950676321c7e42866d4feec30fe10b53f115acf9ef00ca7e334490c36740c74"} Jul 07 22:16:39.658879 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.658547 2581 scope.go:117] "RemoveContainer" containerID="3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77" Jul 07 22:16:39.666591 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.666576 2581 scope.go:117] "RemoveContainer" containerID="3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77" Jul 07 22:16:39.666869 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:16:39.666850 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77\": container with ID starting with 3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77 not found: ID does not exist" containerID="3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77" Jul 07 22:16:39.666939 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.666881 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77"} err="failed to get container status \"3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77\": rpc error: code = NotFound desc = could not find container \"3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77\": container with ID starting with 3d8d9768e8cd6b14438aa86e97e3cc8a2462461eb5e2d50aeb8c889f25292b77 not found: ID does not exist" Jul 07 22:16:39.673872 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.673850 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d65b5659d-dxw7x"] Jul 07 22:16:39.677025 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:39.677007 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d65b5659d-dxw7x"] Jul 07 22:16:41.146065 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:41.146019 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3a652cd-1d9e-4b02-802f-3a3853a494da" path="/var/lib/kubelet/pods/e3a652cd-1d9e-4b02-802f-3a3853a494da/volumes" Jul 07 22:16:42.860846 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:42.860811 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:42.961816 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:42.961780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:43.014604 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:43.014574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:16:45.556048 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:16:45.556015 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mjwhp" Jul 07 22:17:17.493947 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:17.493878 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:17.696268 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:17.696222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:22.580102 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.580066 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d977468f6-wp8wm"] Jul 07 22:17:22.580482 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.580341 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a652cd-1d9e-4b02-802f-3a3853a494da" containerName="console" Jul 07 22:17:22.580482 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.580351 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a652cd-1d9e-4b02-802f-3a3853a494da" containerName="console" Jul 07 22:17:22.580482 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.580409 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a652cd-1d9e-4b02-802f-3a3853a494da" containerName="console" Jul 07 22:17:22.582234 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.582220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.584515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.584485 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 22:17:22.584673 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.584553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 22:17:22.584673 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.584597 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 22:17:22.584673 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.584646 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 22:17:22.584850 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.584798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 22:17:22.584993 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.584977 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mgv2r\"" Jul 07 22:17:22.589358 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.589272 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 22:17:22.596676 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.596653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d977468f6-wp8wm"] Jul 07 22:17:22.625291 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625291 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-telemeter-client-tls\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625480 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-federate-client-tls\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625480 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w65d8\" (UniqueName: \"kubernetes.io/projected/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-kube-api-access-w65d8\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625480 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-serving-certs-ca-bundle\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625480 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-metrics-client-ca\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625605 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-secret-telemeter-client\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.625605 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.625505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.726780 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.726780 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-telemeter-client-tls\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.726931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-federate-client-tls\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.726931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w65d8\" (UniqueName: \"kubernetes.io/projected/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-kube-api-access-w65d8\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.726931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-serving-certs-ca-bundle\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.726931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-metrics-client-ca\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.727110 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-secret-telemeter-client\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.727110 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.726973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.727703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.727674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-serving-certs-ca-bundle\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.727831 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.727677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.727831 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.727719 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-metrics-client-ca\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.729450 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.729429 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-federate-client-tls\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.729601 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.729486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-telemeter-client-tls\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.729744 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.729726 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.729825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.729800 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-secret-telemeter-client\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.734797 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.734777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w65d8\" (UniqueName: \"kubernetes.io/projected/276f0a8d-170b-4016-8c85-70ffcdfd2eaa-kube-api-access-w65d8\") pod \"telemeter-client-7d977468f6-wp8wm\" (UID: \"276f0a8d-170b-4016-8c85-70ffcdfd2eaa\") " pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:22.891858 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:22.891771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" Jul 07 22:17:23.024013 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:23.023906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d977468f6-wp8wm"] Jul 07 22:17:23.026591 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:17:23.026564 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276f0a8d_170b_4016_8c85_70ffcdfd2eaa.slice/crio-66db78f2f26cae3d3707978b650037c50e13f2028745bafbfe2bfd21c157eb77 WatchSource:0}: Error finding container 66db78f2f26cae3d3707978b650037c50e13f2028745bafbfe2bfd21c157eb77: Status 404 returned error can't find the container with id 66db78f2f26cae3d3707978b650037c50e13f2028745bafbfe2bfd21c157eb77 Jul 07 22:17:23.812970 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:23.812937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" event={"ID":"276f0a8d-170b-4016-8c85-70ffcdfd2eaa","Type":"ContainerStarted","Data":"66db78f2f26cae3d3707978b650037c50e13f2028745bafbfe2bfd21c157eb77"} Jul 07 22:17:25.821424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:25.821385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" event={"ID":"276f0a8d-170b-4016-8c85-70ffcdfd2eaa","Type":"ContainerStarted","Data":"6449adf8b328b16d7d8fe9fab7fb0363b69aece70465ae0e5f8474311d8348ae"} Jul 07 22:17:26.826705 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:26.826592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" event={"ID":"276f0a8d-170b-4016-8c85-70ffcdfd2eaa","Type":"ContainerStarted","Data":"fd5549190ef769ad04c39ceece8258aac770bd71bc526d84a4b67e9adf07aa32"} Jul 07 22:17:26.826705 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:26.826701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" event={"ID":"276f0a8d-170b-4016-8c85-70ffcdfd2eaa","Type":"ContainerStarted","Data":"4c91c1f1c4e7aa2b82e50825556dda4dcd313fcd3072211e0195538524171cc4"} Jul 07 22:17:26.848313 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:26.848251 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d977468f6-wp8wm" podStartSLOduration=1.424934076 podStartE2EDuration="4.848235085s" totalImagesPullingTime="3.423301009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:17:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:17:26.847860941 +0000 UTC m=+145.306564609" watchObservedRunningTime="2026-07-07 22:17:26.848235085 +0000 UTC m=+145.306938741" Jul 07 22:17:27.681821 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.681787 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d9c5777c-npzfg"] Jul 07 22:17:27.683906 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.683884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.697352 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.697328 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d9c5777c-npzfg"] Jul 07 22:17:27.760714 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.760677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:27.765774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-config\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.765774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-oauth-config\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.765953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zkhg\" (UniqueName: \"kubernetes.io/projected/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-kube-api-access-9zkhg\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.765953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-oauth-serving-cert\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.765953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-service-ca\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.765953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-trusted-ca-bundle\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.766089 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.765961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-serving-cert\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.852318 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.852284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:27.866572 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-service-ca\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.866689 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-trusted-ca-bundle\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.866754 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-serving-cert\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.866826 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-config\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.866826 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-oauth-config\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.866826 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zkhg\" (UniqueName: \"kubernetes.io/projected/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-kube-api-access-9zkhg\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.866959 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.866852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-oauth-serving-cert\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.867699 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.867673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-config\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.867838 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.867754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-trusted-ca-bundle\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.867838 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.867813 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-oauth-serving-cert\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.867970 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.867866 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-service-ca\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.869396 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.869367 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-serving-cert\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.869499 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.869446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-oauth-config\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.874577 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.874559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zkhg\" (UniqueName: \"kubernetes.io/projected/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-kube-api-access-9zkhg\") pod \"console-55d9c5777c-npzfg\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:27.992414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:27.992379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:28.115213 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:28.115189 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d9c5777c-npzfg"] Jul 07 22:17:28.117818 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:17:28.117793 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8d7e73_c5fd_477f_a33a_f7d963c4ebdf.slice/crio-2156979168aed5b1c3e673a3c64d417fac639dfaec8ac6760aa1f26c8bc695fe WatchSource:0}: Error finding container 2156979168aed5b1c3e673a3c64d417fac639dfaec8ac6760aa1f26c8bc695fe: Status 404 returned error can't find the container with id 2156979168aed5b1c3e673a3c64d417fac639dfaec8ac6760aa1f26c8bc695fe Jul 07 22:17:28.834188 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:28.834152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9c5777c-npzfg" event={"ID":"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf","Type":"ContainerStarted","Data":"04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3"} Jul 07 22:17:28.834188 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:28.834198 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9c5777c-npzfg" event={"ID":"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf","Type":"ContainerStarted","Data":"2156979168aed5b1c3e673a3c64d417fac639dfaec8ac6760aa1f26c8bc695fe"} Jul 07 22:17:28.862425 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:28.862362 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55d9c5777c-npzfg" podStartSLOduration=1.8623395889999999 podStartE2EDuration="1.862339589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:17:28.861768976 +0000 UTC m=+147.320472670" watchObservedRunningTime="2026-07-07 22:17:28.862339589 +0000 UTC m=+147.321043246" Jul 07 22:17:32.699413 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:32.699380 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:32.749978 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:32.749934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:35.438514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.438482 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d9c5777c-npzfg"] Jul 07 22:17:35.459989 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.459942 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755b8bc6f-gk5k4"] Jul 07 22:17:35.462243 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.462222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.469948 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.469921 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755b8bc6f-gk5k4"] Jul 07 22:17:35.531141 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-oauth-serving-cert\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.531141 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-serving-cert\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.531358 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzpn\" (UniqueName: \"kubernetes.io/projected/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-kube-api-access-qzzpn\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.531358 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-oauth-config\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.531358 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-config\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.531358 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-service-ca\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.531358 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.531353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-trusted-ca-bundle\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632484 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzpn\" (UniqueName: \"kubernetes.io/projected/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-kube-api-access-qzzpn\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-oauth-config\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-config\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-service-ca\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-trusted-ca-bundle\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632862 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-oauth-serving-cert\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.632862 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.632827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-serving-cert\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.633323 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.633295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-config\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.633423 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.633389 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-service-ca\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.633473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.633442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-trusted-ca-bundle\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.633517 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.633486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-oauth-serving-cert\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.635102 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.635070 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-oauth-config\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.635192 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.635156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-serving-cert\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.640869 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.640843 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzpn\" (UniqueName: \"kubernetes.io/projected/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-kube-api-access-qzzpn\") pod \"console-755b8bc6f-gk5k4\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.651065 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.651023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:35.702738 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.702658 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:35.771661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.771633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:35.903417 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:35.903385 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755b8bc6f-gk5k4"] Jul 07 22:17:35.906188 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:17:35.906163 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9cc881_26c6_4e91_b3ba_013e06aa6b28.slice/crio-2bb13adfbd7fb198376d3c55fc7694c97daff0067d18f361bc6ece0c992b8233 WatchSource:0}: Error finding container 2bb13adfbd7fb198376d3c55fc7694c97daff0067d18f361bc6ece0c992b8233: Status 404 returned error can't find the container with id 2bb13adfbd7fb198376d3c55fc7694c97daff0067d18f361bc6ece0c992b8233 Jul 07 22:17:36.244875 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:36.244847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:36.867297 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:36.867262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b8bc6f-gk5k4" event={"ID":"dc9cc881-26c6-4e91-b3ba-013e06aa6b28","Type":"ContainerStarted","Data":"0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936"} Jul 07 22:17:36.867802 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:36.867312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b8bc6f-gk5k4" event={"ID":"dc9cc881-26c6-4e91-b3ba-013e06aa6b28","Type":"ContainerStarted","Data":"2bb13adfbd7fb198376d3c55fc7694c97daff0067d18f361bc6ece0c992b8233"} Jul 07 22:17:36.885506 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:36.885454 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755b8bc6f-gk5k4" podStartSLOduration=1.8854371479999998 podStartE2EDuration="1.885437148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:17:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:17:36.883918001 +0000 UTC m=+155.342621717" watchObservedRunningTime="2026-07-07 22:17:36.885437148 +0000 UTC m=+155.344140803" Jul 07 22:17:37.993197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:37.993161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:17:44.596315 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:44.596258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:44.648254 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:44.648207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:45.772795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:45.772765 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:45.773173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:45.772852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:45.777542 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:45.777524 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:45.902342 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:45.902315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:17:45.945473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:45.945440 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bbc4ccbff-t49h8"] Jul 07 22:17:46.045031 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:46.044921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:46.096361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:46.096321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:46.153328 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:46.153274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:50.863883 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:50.863822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:50.964922 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:50.964883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:51.065792 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:51.065750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:52.589861 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:52.589811 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:17:52.638837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:17:52.638789 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:18:00.458429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.458330 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55d9c5777c-npzfg" podUID="cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" containerName="console" containerID="cri-o://04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3" gracePeriod=15 Jul 07 22:18:00.705001 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.704977 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:18:00.740810 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.740788 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-oauth-config\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.740946 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.740824 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-config\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.740946 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.740842 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-serving-cert\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.740946 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.740882 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-service-ca\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.741104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741003 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zkhg\" (UniqueName: \"kubernetes.io/projected/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-kube-api-access-9zkhg\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.741104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741083 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-trusted-ca-bundle\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.741207 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741123 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-oauth-serving-cert\") pod \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\" (UID: \"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf\") " Jul 07 22:18:00.741254 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741227 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:00.741254 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741237 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-config" (OuterVolumeSpecName: "console-config") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:00.741399 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741382 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.741451 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741405 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-service-ca\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.741519 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741491 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:00.741566 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.741539 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:00.742953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.742930 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:18:00.743340 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.743319 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:18:00.743400 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.743328 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-kube-api-access-9zkhg" (OuterVolumeSpecName: "kube-api-access-9zkhg") pod "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" (UID: "cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf"). InnerVolumeSpecName "kube-api-access-9zkhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:18:00.841972 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.841939 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zkhg\" (UniqueName: \"kubernetes.io/projected/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-kube-api-access-9zkhg\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.841972 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.841967 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-trusted-ca-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.841972 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.841977 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-oauth-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.842187 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.841986 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-oauth-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.842187 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.841995 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf-console-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:00.955999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.955962 2581 generic.go:356] "Generic (PLEG): container finished" podID="cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" containerID="04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3" exitCode=0 Jul 07 22:18:00.956174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.956005 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9c5777c-npzfg" Jul 07 22:18:00.956174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.956025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9c5777c-npzfg" event={"ID":"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf","Type":"ContainerDied","Data":"04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3"} Jul 07 22:18:00.956174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.956075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9c5777c-npzfg" event={"ID":"cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf","Type":"ContainerDied","Data":"2156979168aed5b1c3e673a3c64d417fac639dfaec8ac6760aa1f26c8bc695fe"} Jul 07 22:18:00.956174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.956103 2581 scope.go:117] "RemoveContainer" containerID="04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3" Jul 07 22:18:00.964514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.964495 2581 scope.go:117] "RemoveContainer" containerID="04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3" Jul 07 22:18:00.964777 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:18:00.964761 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3\": container with ID starting with 04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3 not found: ID does not exist" containerID="04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3" Jul 07 22:18:00.964830 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.964785 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3"} err="failed to get container status \"04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3\": rpc error: code = NotFound desc = could not find container \"04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3\": container with ID starting with 04fb4e32e8d70ef8dc47ec2eb10d052421d4cf9394de43251a7bc91c6769e8d3 not found: ID does not exist" Jul 07 22:18:00.975253 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.975231 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d9c5777c-npzfg"] Jul 07 22:18:00.981149 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:00.981127 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55d9c5777c-npzfg"] Jul 07 22:18:01.143387 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:01.143293 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" path="/var/lib/kubelet/pods/cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf/volumes" Jul 07 22:18:10.965572 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:10.965530 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6bbc4ccbff-t49h8" podUID="ea6d2dfd-1ddf-4e5b-8542-75622770a94c" containerName="console" containerID="cri-o://ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19" gracePeriod=15 Jul 07 22:18:11.212032 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.212002 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:18:11.324583 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324546 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-oauth-config\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.324583 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324586 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-oauth-serving-cert\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.324844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324606 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-service-ca\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.324844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt5z8\" (UniqueName: \"kubernetes.io/projected/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-kube-api-access-tt5z8\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.324844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324669 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-serving-cert\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.324844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324736 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-config\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.324844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324757 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-trusted-ca-bundle\") pod \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\" (UID: \"ea6d2dfd-1ddf-4e5b-8542-75622770a94c\") " Jul 07 22:18:11.325083 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.324950 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:11.325226 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.325195 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:11.325304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.325207 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-config" (OuterVolumeSpecName: "console-config") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:11.325304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.325247 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:18:11.326966 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.326938 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-kube-api-access-tt5z8" (OuterVolumeSpecName: "kube-api-access-tt5z8") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "kube-api-access-tt5z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:18:11.326966 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.326951 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:18:11.327110 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.327011 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea6d2dfd-1ddf-4e5b-8542-75622770a94c" (UID: "ea6d2dfd-1ddf-4e5b-8542-75622770a94c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:18:11.425658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425586 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-service-ca\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.425658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425654 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt5z8\" (UniqueName: \"kubernetes.io/projected/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-kube-api-access-tt5z8\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.425658 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425669 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.425902 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425682 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.425902 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425694 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-trusted-ca-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.425902 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425704 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-console-oauth-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.425902 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.425717 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6d2dfd-1ddf-4e5b-8542-75622770a94c-oauth-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:18:11.996118 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.996087 2581 generic.go:356] "Generic (PLEG): container finished" podID="ea6d2dfd-1ddf-4e5b-8542-75622770a94c" containerID="ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19" exitCode=0 Jul 07 22:18:11.996556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.996134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbc4ccbff-t49h8" event={"ID":"ea6d2dfd-1ddf-4e5b-8542-75622770a94c","Type":"ContainerDied","Data":"ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19"} Jul 07 22:18:11.996556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.996141 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbc4ccbff-t49h8" Jul 07 22:18:11.996556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.996175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbc4ccbff-t49h8" event={"ID":"ea6d2dfd-1ddf-4e5b-8542-75622770a94c","Type":"ContainerDied","Data":"4e826a8bd74912fcc0add14224fc6bf0f038879999c3827f02c0d9c27964499c"} Jul 07 22:18:11.996556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:11.996195 2581 scope.go:117] "RemoveContainer" containerID="ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19" Jul 07 22:18:12.004885 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:12.004869 2581 scope.go:117] "RemoveContainer" containerID="ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19" Jul 07 22:18:12.005149 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:18:12.005126 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19\": container with ID starting with ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19 not found: ID does not exist" containerID="ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19" Jul 07 22:18:12.005217 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:12.005156 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19"} err="failed to get container status \"ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19\": rpc error: code = NotFound desc = could not find container \"ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19\": container with ID starting with ba1a62704f9c006bf72e09aa54608a03eacbbffc878e1e84538b4bd1e41dcc19 not found: ID does not exist" Jul 07 22:18:12.017202 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:12.017176 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bbc4ccbff-t49h8"] Jul 07 22:18:12.022651 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:12.022631 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bbc4ccbff-t49h8"] Jul 07 22:18:13.147203 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:13.147170 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea6d2dfd-1ddf-4e5b-8542-75622770a94c" path="/var/lib/kubelet/pods/ea6d2dfd-1ddf-4e5b-8542-75622770a94c/volumes" Jul 07 22:18:51.546864 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:51.546822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:18:51.647600 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:51.647546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:18:52.236074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236041 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh"] Jul 07 22:18:52.236336 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236325 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" containerName="console" Jul 07 22:18:52.236381 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236337 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" containerName="console" Jul 07 22:18:52.236381 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236347 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6d2dfd-1ddf-4e5b-8542-75622770a94c" containerName="console" Jul 07 22:18:52.236381 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236352 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6d2dfd-1ddf-4e5b-8542-75622770a94c" containerName="console" Jul 07 22:18:52.236473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236397 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6d2dfd-1ddf-4e5b-8542-75622770a94c" containerName="console" Jul 07 22:18:52.236473 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.236403 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8d7e73-c5fd-477f-a33a-f7d963c4ebdf" containerName="console" Jul 07 22:18:52.239379 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.239364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.242140 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.242122 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wlx8\"" Jul 07 22:18:52.242400 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.242387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 22:18:52.243036 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.243018 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 22:18:52.268782 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.268751 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh"] Jul 07 22:18:52.342743 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.342708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.342743 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.342758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.342960 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.342785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmg2q\" (UniqueName: \"kubernetes.io/projected/3149f099-0eb5-480d-92a5-154c7fde7824-kube-api-access-fmg2q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.443993 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.443955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.444173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.444006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.444173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.444034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmg2q\" (UniqueName: \"kubernetes.io/projected/3149f099-0eb5-480d-92a5-154c7fde7824-kube-api-access-fmg2q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.444331 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.444311 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.444372 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.444335 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.452190 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.452172 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmg2q\" (UniqueName: \"kubernetes.io/projected/3149f099-0eb5-480d-92a5-154c7fde7824-kube-api-access-fmg2q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.548135 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.548049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:18:52.675475 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:52.675007 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh"] Jul 07 22:18:52.680640 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:18:52.680595 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3149f099_0eb5_480d_92a5_154c7fde7824.slice/crio-0c61ed0f824e68fda96381bb7ceca250b459bb1f4ff2317e4f373b1b9bb701aa WatchSource:0}: Error finding container 0c61ed0f824e68fda96381bb7ceca250b459bb1f4ff2317e4f373b1b9bb701aa: Status 404 returned error can't find the container with id 0c61ed0f824e68fda96381bb7ceca250b459bb1f4ff2317e4f373b1b9bb701aa Jul 07 22:18:53.144212 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:18:53.144178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" event={"ID":"3149f099-0eb5-480d-92a5-154c7fde7824","Type":"ContainerStarted","Data":"0c61ed0f824e68fda96381bb7ceca250b459bb1f4ff2317e4f373b1b9bb701aa"} Jul 07 22:19:01.177105 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:01.177059 2581 generic.go:356] "Generic (PLEG): container finished" podID="3149f099-0eb5-480d-92a5-154c7fde7824" containerID="6cf40d6bc8d97e9f9da9732ab0d6d7e64566f0b30f0d20e2b866d460c409e28b" exitCode=0 Jul 07 22:19:01.177501 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:01.177140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" event={"ID":"3149f099-0eb5-480d-92a5-154c7fde7824","Type":"ContainerDied","Data":"6cf40d6bc8d97e9f9da9732ab0d6d7e64566f0b30f0d20e2b866d460c409e28b"} Jul 07 22:19:04.190830 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:04.190790 2581 generic.go:356] "Generic (PLEG): container finished" podID="3149f099-0eb5-480d-92a5-154c7fde7824" containerID="11a60b06db4ade18e3504c4be4c3147865f1b0c948e20a9bb61c80ec0d30cd5f" exitCode=0 Jul 07 22:19:04.191202 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:04.190838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" event={"ID":"3149f099-0eb5-480d-92a5-154c7fde7824","Type":"ContainerDied","Data":"11a60b06db4ade18e3504c4be4c3147865f1b0c948e20a9bb61c80ec0d30cd5f"} Jul 07 22:19:12.223417 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:12.223330 2581 generic.go:356] "Generic (PLEG): container finished" podID="3149f099-0eb5-480d-92a5-154c7fde7824" containerID="9c739403a0a5749eac57fa8229db2333515d0d9cd206206001e7d0fee42841c4" exitCode=0 Jul 07 22:19:12.223417 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:12.223397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" event={"ID":"3149f099-0eb5-480d-92a5-154c7fde7824","Type":"ContainerDied","Data":"9c739403a0a5749eac57fa8229db2333515d0d9cd206206001e7d0fee42841c4"} Jul 07 22:19:13.355087 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.355065 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:19:13.408916 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.408880 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-bundle\") pod \"3149f099-0eb5-480d-92a5-154c7fde7824\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " Jul 07 22:19:13.409088 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.408946 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmg2q\" (UniqueName: \"kubernetes.io/projected/3149f099-0eb5-480d-92a5-154c7fde7824-kube-api-access-fmg2q\") pod \"3149f099-0eb5-480d-92a5-154c7fde7824\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " Jul 07 22:19:13.409088 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.408996 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-util\") pod \"3149f099-0eb5-480d-92a5-154c7fde7824\" (UID: \"3149f099-0eb5-480d-92a5-154c7fde7824\") " Jul 07 22:19:13.409566 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.409536 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-bundle" (OuterVolumeSpecName: "bundle") pod "3149f099-0eb5-480d-92a5-154c7fde7824" (UID: "3149f099-0eb5-480d-92a5-154c7fde7824"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:19:13.411057 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.411026 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3149f099-0eb5-480d-92a5-154c7fde7824-kube-api-access-fmg2q" (OuterVolumeSpecName: "kube-api-access-fmg2q") pod "3149f099-0eb5-480d-92a5-154c7fde7824" (UID: "3149f099-0eb5-480d-92a5-154c7fde7824"). InnerVolumeSpecName "kube-api-access-fmg2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:19:13.413712 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.413690 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-util" (OuterVolumeSpecName: "util") pod "3149f099-0eb5-480d-92a5-154c7fde7824" (UID: "3149f099-0eb5-480d-92a5-154c7fde7824"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:19:13.510326 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.510291 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:13.510326 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.510322 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmg2q\" (UniqueName: \"kubernetes.io/projected/3149f099-0eb5-480d-92a5-154c7fde7824-kube-api-access-fmg2q\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:13.510506 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:13.510332 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3149f099-0eb5-480d-92a5-154c7fde7824-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:14.232303 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:14.232279 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" Jul 07 22:19:14.232303 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:14.232284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wnqsh" event={"ID":"3149f099-0eb5-480d-92a5-154c7fde7824","Type":"ContainerDied","Data":"0c61ed0f824e68fda96381bb7ceca250b459bb1f4ff2317e4f373b1b9bb701aa"} Jul 07 22:19:14.232544 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:14.232328 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c61ed0f824e68fda96381bb7ceca250b459bb1f4ff2317e4f373b1b9bb701aa" Jul 07 22:19:18.231599 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:18.231559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:19.822912 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:19.822875 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:20.202601 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202525 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9"] Jul 07 22:19:20.202833 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202820 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="util" Jul 07 22:19:20.202878 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202835 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="util" Jul 07 22:19:20.202878 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202855 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="extract" Jul 07 22:19:20.202878 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202861 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="extract" Jul 07 22:19:20.202878 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202873 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="pull" Jul 07 22:19:20.202878 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202877 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="pull" Jul 07 22:19:20.203018 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.202918 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3149f099-0eb5-480d-92a5-154c7fde7824" containerName="extract" Jul 07 22:19:20.205958 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.205942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.208226 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.208203 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 22:19:20.208347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.208322 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-62b7m\"" Jul 07 22:19:20.208409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.208397 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 22:19:20.218901 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.218882 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9"] Jul 07 22:19:20.261301 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.261272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qw7\" (UniqueName: \"kubernetes.io/projected/580cd179-c24a-4048-b33d-7573c38392c5-kube-api-access-b7qw7\") pod \"cert-manager-operator-controller-manager-55c444bf86-62bs9\" (UID: \"580cd179-c24a-4048-b33d-7573c38392c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.261449 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.261312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580cd179-c24a-4048-b33d-7573c38392c5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-62bs9\" (UID: \"580cd179-c24a-4048-b33d-7573c38392c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.362637 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.362578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qw7\" (UniqueName: \"kubernetes.io/projected/580cd179-c24a-4048-b33d-7573c38392c5-kube-api-access-b7qw7\") pod \"cert-manager-operator-controller-manager-55c444bf86-62bs9\" (UID: \"580cd179-c24a-4048-b33d-7573c38392c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.362798 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.362655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580cd179-c24a-4048-b33d-7573c38392c5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-62bs9\" (UID: \"580cd179-c24a-4048-b33d-7573c38392c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.363041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.363020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580cd179-c24a-4048-b33d-7573c38392c5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-62bs9\" (UID: \"580cd179-c24a-4048-b33d-7573c38392c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.373463 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.373439 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qw7\" (UniqueName: \"kubernetes.io/projected/580cd179-c24a-4048-b33d-7573c38392c5-kube-api-access-b7qw7\") pod \"cert-manager-operator-controller-manager-55c444bf86-62bs9\" (UID: \"580cd179-c24a-4048-b33d-7573c38392c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.514732 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.514699 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" Jul 07 22:19:20.642331 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:20.642308 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9"] Jul 07 22:19:20.645244 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:20.645216 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580cd179_c24a_4048_b33d_7573c38392c5.slice/crio-4648181f0b6004cd4bdcbef7476da2bb0b236071c4b72a2c4ffec2eb208504ee WatchSource:0}: Error finding container 4648181f0b6004cd4bdcbef7476da2bb0b236071c4b72a2c4ffec2eb208504ee: Status 404 returned error can't find the container with id 4648181f0b6004cd4bdcbef7476da2bb0b236071c4b72a2c4ffec2eb208504ee Jul 07 22:19:21.259780 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:21.259740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" event={"ID":"580cd179-c24a-4048-b33d-7573c38392c5","Type":"ContainerStarted","Data":"4648181f0b6004cd4bdcbef7476da2bb0b236071c4b72a2c4ffec2eb208504ee"} Jul 07 22:19:21.844356 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:21.844290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:21.943429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:21.943397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:22.265360 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:22.265325 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" event={"ID":"580cd179-c24a-4048-b33d-7573c38392c5","Type":"ContainerStarted","Data":"eafddd2fe9da98fcf1f5bf641c1d23b89ee42e1dacfc834349b2b7de4089eeae"} Jul 07 22:19:22.286265 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:22.286212 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-62bs9" podStartSLOduration=0.893234816 podStartE2EDuration="2.286193202s" totalImagesPullingTime="1.392958386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:19:22.285133419 +0000 UTC m=+260.743837079" watchObservedRunningTime="2026-07-07 22:19:22.286193202 +0000 UTC m=+260.744896856" Jul 07 22:19:22.717734 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:22.717630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:22.829258 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:22.829223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:23.655919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.655840 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j"] Jul 07 22:19:23.658061 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.658044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.660384 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.660365 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 22:19:23.661188 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.661163 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 22:19:23.661188 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.661186 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wlx8\"" Jul 07 22:19:23.666701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.666678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j"] Jul 07 22:19:23.689915 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.689888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.690013 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.689949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chgt\" (UniqueName: \"kubernetes.io/projected/02b7b90a-8547-4a6e-9c06-298e634888b6-kube-api-access-2chgt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.690013 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.689996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.785117 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.785080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:23.791054 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.791025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.791168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.791063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.791168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.791094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chgt\" (UniqueName: \"kubernetes.io/projected/02b7b90a-8547-4a6e-9c06-298e634888b6-kube-api-access-2chgt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.791377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.791360 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.791423 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.791388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.800987 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.800964 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chgt\" (UniqueName: \"kubernetes.io/projected/02b7b90a-8547-4a6e-9c06-298e634888b6-kube-api-access-2chgt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:23.886415 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.886376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:23.967317 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:23.967235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:24.097702 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:24.097679 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j"] Jul 07 22:19:24.099965 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:24.099927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b7b90a_8547_4a6e_9c06_298e634888b6.slice/crio-2ff54383b8134232ec01f0d8798c64c0327540117fcaab1ce3fe6e96c81f8a94 WatchSource:0}: Error finding container 2ff54383b8134232ec01f0d8798c64c0327540117fcaab1ce3fe6e96c81f8a94: Status 404 returned error can't find the container with id 2ff54383b8134232ec01f0d8798c64c0327540117fcaab1ce3fe6e96c81f8a94 Jul 07 22:19:24.274266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:24.274232 2581 generic.go:356] "Generic (PLEG): container finished" podID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerID="43347f266449e9129a090a12cff8a71f2fe92e136d7545915d67cc74191cbef1" exitCode=0 Jul 07 22:19:24.274441 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:24.274328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" event={"ID":"02b7b90a-8547-4a6e-9c06-298e634888b6","Type":"ContainerDied","Data":"43347f266449e9129a090a12cff8a71f2fe92e136d7545915d67cc74191cbef1"} Jul 07 22:19:24.274441 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:24.274382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" event={"ID":"02b7b90a-8547-4a6e-9c06-298e634888b6","Type":"ContainerStarted","Data":"2ff54383b8134232ec01f0d8798c64c0327540117fcaab1ce3fe6e96c81f8a94"} Jul 07 22:19:25.802429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:25.802398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:26.188583 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.188508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:26.398132 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.398097 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dp897"] Jul 07 22:19:26.400192 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.400175 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.402447 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.402431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 22:19:26.403368 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.403351 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 22:19:26.403460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.403397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-k58cb\"" Jul 07 22:19:26.409734 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.409712 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dp897"] Jul 07 22:19:26.495127 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.495100 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8wpdb"] Jul 07 22:19:26.497180 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.497165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.499359 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.499344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-96dhs\"" Jul 07 22:19:26.506874 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.506844 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8wpdb"] Jul 07 22:19:26.515343 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.515319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64b5l\" (UniqueName: \"kubernetes.io/projected/9a1bc98b-e5d8-4c09-9427-b114379a5dce-kube-api-access-64b5l\") pod \"cert-manager-cainjector-559cdd8c87-dp897\" (UID: \"9a1bc98b-e5d8-4c09-9427-b114379a5dce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.515463 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.515368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1bc98b-e5d8-4c09-9427-b114379a5dce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dp897\" (UID: \"9a1bc98b-e5d8-4c09-9427-b114379a5dce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.615931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.615890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1bc98b-e5d8-4c09-9427-b114379a5dce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dp897\" (UID: \"9a1bc98b-e5d8-4c09-9427-b114379a5dce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.616091 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.615942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f804b4d-70a2-4b61-8cad-a7403b87676d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8wpdb\" (UID: \"1f804b4d-70a2-4b61-8cad-a7403b87676d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.616091 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.616008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlbpm\" (UniqueName: \"kubernetes.io/projected/1f804b4d-70a2-4b61-8cad-a7403b87676d-kube-api-access-qlbpm\") pod \"cert-manager-webhook-6486ffd997-8wpdb\" (UID: \"1f804b4d-70a2-4b61-8cad-a7403b87676d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.616091 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.616039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64b5l\" (UniqueName: \"kubernetes.io/projected/9a1bc98b-e5d8-4c09-9427-b114379a5dce-kube-api-access-64b5l\") pod \"cert-manager-cainjector-559cdd8c87-dp897\" (UID: \"9a1bc98b-e5d8-4c09-9427-b114379a5dce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.627821 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.627796 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64b5l\" (UniqueName: \"kubernetes.io/projected/9a1bc98b-e5d8-4c09-9427-b114379a5dce-kube-api-access-64b5l\") pod \"cert-manager-cainjector-559cdd8c87-dp897\" (UID: \"9a1bc98b-e5d8-4c09-9427-b114379a5dce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.628499 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.628482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1bc98b-e5d8-4c09-9427-b114379a5dce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dp897\" (UID: \"9a1bc98b-e5d8-4c09-9427-b114379a5dce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.717078 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.717043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f804b4d-70a2-4b61-8cad-a7403b87676d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8wpdb\" (UID: \"1f804b4d-70a2-4b61-8cad-a7403b87676d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.717242 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.717099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlbpm\" (UniqueName: \"kubernetes.io/projected/1f804b4d-70a2-4b61-8cad-a7403b87676d-kube-api-access-qlbpm\") pod \"cert-manager-webhook-6486ffd997-8wpdb\" (UID: \"1f804b4d-70a2-4b61-8cad-a7403b87676d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.717939 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.717922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" Jul 07 22:19:26.728914 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.728888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f804b4d-70a2-4b61-8cad-a7403b87676d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8wpdb\" (UID: \"1f804b4d-70a2-4b61-8cad-a7403b87676d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.729063 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.729031 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlbpm\" (UniqueName: \"kubernetes.io/projected/1f804b4d-70a2-4b61-8cad-a7403b87676d-kube-api-access-qlbpm\") pod \"cert-manager-webhook-6486ffd997-8wpdb\" (UID: \"1f804b4d-70a2-4b61-8cad-a7403b87676d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.806953 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.806928 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:26.843513 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.843470 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dp897"] Jul 07 22:19:26.847713 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:26.847682 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a1bc98b_e5d8_4c09_9427_b114379a5dce.slice/crio-ed5a735e782e26d93c5f946b54aae6ec53f5371266e1e3d6c399de9024b1c4de WatchSource:0}: Error finding container ed5a735e782e26d93c5f946b54aae6ec53f5371266e1e3d6c399de9024b1c4de: Status 404 returned error can't find the container with id ed5a735e782e26d93c5f946b54aae6ec53f5371266e1e3d6c399de9024b1c4de Jul 07 22:19:26.935731 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:26.935701 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8wpdb"] Jul 07 22:19:26.939267 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:26.939243 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f804b4d_70a2_4b61_8cad_a7403b87676d.slice/crio-d026ce8da287c5c7eb7f59577caec194975900a8a8788e5d1e795644db81c9ee WatchSource:0}: Error finding container d026ce8da287c5c7eb7f59577caec194975900a8a8788e5d1e795644db81c9ee: Status 404 returned error can't find the container with id d026ce8da287c5c7eb7f59577caec194975900a8a8788e5d1e795644db81c9ee Jul 07 22:19:27.289340 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:27.289298 2581 generic.go:356] "Generic (PLEG): container finished" podID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerID="72b90f07308203656cf0c77513956cdddd7a919458970f72d1a05631c03274e0" exitCode=0 Jul 07 22:19:27.289524 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:27.289369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" event={"ID":"02b7b90a-8547-4a6e-9c06-298e634888b6","Type":"ContainerDied","Data":"72b90f07308203656cf0c77513956cdddd7a919458970f72d1a05631c03274e0"} Jul 07 22:19:27.290785 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:27.290759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" event={"ID":"1f804b4d-70a2-4b61-8cad-a7403b87676d","Type":"ContainerStarted","Data":"d026ce8da287c5c7eb7f59577caec194975900a8a8788e5d1e795644db81c9ee"} Jul 07 22:19:27.292129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:27.292098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" event={"ID":"9a1bc98b-e5d8-4c09-9427-b114379a5dce","Type":"ContainerStarted","Data":"ed5a735e782e26d93c5f946b54aae6ec53f5371266e1e3d6c399de9024b1c4de"} Jul 07 22:19:28.300681 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:28.300644 2581 generic.go:356] "Generic (PLEG): container finished" podID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerID="b9c99cbb01722c887d234c574ca13225b1227eb655fdacd2d5aefd1e006bb3ea" exitCode=0 Jul 07 22:19:28.301143 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:28.300772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" event={"ID":"02b7b90a-8547-4a6e-9c06-298e634888b6","Type":"ContainerDied","Data":"b9c99cbb01722c887d234c574ca13225b1227eb655fdacd2d5aefd1e006bb3ea"} Jul 07 22:19:28.634717 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:28.634602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:28.691141 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:28.691104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:29.437333 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.437313 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:29.535282 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.535242 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-bundle\") pod \"02b7b90a-8547-4a6e-9c06-298e634888b6\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " Jul 07 22:19:29.535438 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.535365 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2chgt\" (UniqueName: \"kubernetes.io/projected/02b7b90a-8547-4a6e-9c06-298e634888b6-kube-api-access-2chgt\") pod \"02b7b90a-8547-4a6e-9c06-298e634888b6\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " Jul 07 22:19:29.535438 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.535401 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-util\") pod \"02b7b90a-8547-4a6e-9c06-298e634888b6\" (UID: \"02b7b90a-8547-4a6e-9c06-298e634888b6\") " Jul 07 22:19:29.535766 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.535738 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-bundle" (OuterVolumeSpecName: "bundle") pod "02b7b90a-8547-4a6e-9c06-298e634888b6" (UID: "02b7b90a-8547-4a6e-9c06-298e634888b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:19:29.537557 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.537534 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02b7b90a-8547-4a6e-9c06-298e634888b6-kube-api-access-2chgt" (OuterVolumeSpecName: "kube-api-access-2chgt") pod "02b7b90a-8547-4a6e-9c06-298e634888b6" (UID: "02b7b90a-8547-4a6e-9c06-298e634888b6"). InnerVolumeSpecName "kube-api-access-2chgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:19:29.543082 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.543055 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-util" (OuterVolumeSpecName: "util") pod "02b7b90a-8547-4a6e-9c06-298e634888b6" (UID: "02b7b90a-8547-4a6e-9c06-298e634888b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:19:29.636293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.636194 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2chgt\" (UniqueName: \"kubernetes.io/projected/02b7b90a-8547-4a6e-9c06-298e634888b6-kube-api-access-2chgt\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:29.636293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.636233 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:29.636293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:29.636248 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b7b90a-8547-4a6e-9c06-298e634888b6-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:30.311388 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.311347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" event={"ID":"02b7b90a-8547-4a6e-9c06-298e634888b6","Type":"ContainerDied","Data":"2ff54383b8134232ec01f0d8798c64c0327540117fcaab1ce3fe6e96c81f8a94"} Jul 07 22:19:30.311388 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.311384 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9jh5j" Jul 07 22:19:30.311654 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.311411 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ff54383b8134232ec01f0d8798c64c0327540117fcaab1ce3fe6e96c81f8a94" Jul 07 22:19:30.312829 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.312805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" event={"ID":"1f804b4d-70a2-4b61-8cad-a7403b87676d","Type":"ContainerStarted","Data":"346b7b205c0b5ac5372a8765920155d7596303b118559909545086e42f53957b"} Jul 07 22:19:30.312943 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.312844 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:30.314251 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.314226 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" event={"ID":"9a1bc98b-e5d8-4c09-9427-b114379a5dce","Type":"ContainerStarted","Data":"5e2adc812dce8b722e7955760fccb4ce036d76e16bb9c145d5513b23614d4987"} Jul 07 22:19:30.329215 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.329177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" podStartSLOduration=1.899438685 podStartE2EDuration="4.32916413s" totalImagesPullingTime="2.429725445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:19:30.327489369 +0000 UTC m=+268.786193041" watchObservedRunningTime="2026-07-07 22:19:30.32916413 +0000 UTC m=+268.787867784" Jul 07 22:19:30.343296 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:30.343254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dp897" podStartSLOduration=1.812153919 podStartE2EDuration="4.343240212s" totalImagesPullingTime="2.531086293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:19:30.342076888 +0000 UTC m=+268.800780567" watchObservedRunningTime="2026-07-07 22:19:30.343240212 +0000 UTC m=+268.801943866" Jul 07 22:19:31.135764 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:31.135724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:31.236342 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:31.236305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:32.050856 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:32.050821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:32.145599 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:32.145569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:34.080447 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080411 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf"] Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080710 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="util" Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080721 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="util" Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080738 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="pull" Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080743 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="pull" Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080750 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="extract" Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080756 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="extract" Jul 07 22:19:34.080834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.080803 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="02b7b90a-8547-4a6e-9c06-298e634888b6" containerName="extract" Jul 07 22:19:34.082802 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.082787 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.084990 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.084959 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 22:19:34.085112 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.085005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 22:19:34.085981 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.085967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bgd2z\"" Jul 07 22:19:34.091539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.091514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf"] Jul 07 22:19:34.174643 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.174494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n98qw\" (UniqueName: \"kubernetes.io/projected/5b8160fe-621c-461b-a2aa-6c05a6c3eb5e-kube-api-access-n98qw\") pod \"openshift-lws-operator-fd8ccff4c-9xtgf\" (UID: \"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.174643 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.174629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8160fe-621c-461b-a2aa-6c05a6c3eb5e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9xtgf\" (UID: \"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.275632 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.275559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8160fe-621c-461b-a2aa-6c05a6c3eb5e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9xtgf\" (UID: \"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.275844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.275661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98qw\" (UniqueName: \"kubernetes.io/projected/5b8160fe-621c-461b-a2aa-6c05a6c3eb5e-kube-api-access-n98qw\") pod \"openshift-lws-operator-fd8ccff4c-9xtgf\" (UID: \"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.276044 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.276020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8160fe-621c-461b-a2aa-6c05a6c3eb5e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9xtgf\" (UID: \"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.283339 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.283314 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n98qw\" (UniqueName: \"kubernetes.io/projected/5b8160fe-621c-461b-a2aa-6c05a6c3eb5e-kube-api-access-n98qw\") pod \"openshift-lws-operator-fd8ccff4c-9xtgf\" (UID: \"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.393408 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.393324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" Jul 07 22:19:34.400433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.400403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:34.517234 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:34.517210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf"] Jul 07 22:19:34.519670 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:34.519641 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b8160fe_621c_461b_a2aa_6c05a6c3eb5e.slice/crio-7c52a8c417226fa2cba9d2a8545ff81dc565b6c3cf97ac65df67abf4a3da42cf WatchSource:0}: Error finding container 7c52a8c417226fa2cba9d2a8545ff81dc565b6c3cf97ac65df67abf4a3da42cf: Status 404 returned error can't find the container with id 7c52a8c417226fa2cba9d2a8545ff81dc565b6c3cf97ac65df67abf4a3da42cf Jul 07 22:19:35.336435 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:35.336393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" event={"ID":"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e","Type":"ContainerStarted","Data":"7c52a8c417226fa2cba9d2a8545ff81dc565b6c3cf97ac65df67abf4a3da42cf"} Jul 07 22:19:36.320514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:36.320421 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8wpdb" Jul 07 22:19:36.343066 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:36.343027 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" event={"ID":"5b8160fe-621c-461b-a2aa-6c05a6c3eb5e","Type":"ContainerStarted","Data":"bd6e95406e6ca9e489d51723f467984434ac6c9dfb5880b9c56af5fbc790fdd1"} Jul 07 22:19:36.359579 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:36.359519 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xtgf" podStartSLOduration=0.868191838 podStartE2EDuration="2.359502763s" totalImagesPullingTime="1.491310925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:19:36.357439578 +0000 UTC m=+274.816143234" watchObservedRunningTime="2026-07-07 22:19:36.359502763 +0000 UTC m=+274.818206417" Jul 07 22:19:37.033889 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:37.033853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:37.132912 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:37.132877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:39.121912 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.121880 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56"] Jul 07 22:19:39.125496 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.125471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.128701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.128679 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wlx8\"" Jul 07 22:19:39.128861 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.128842 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 22:19:39.129195 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.129182 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 22:19:39.136145 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.136122 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56"] Jul 07 22:19:39.216466 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.216430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.216466 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.216463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.216696 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.216506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzglz\" (UniqueName: \"kubernetes.io/projected/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-kube-api-access-dzglz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.290341 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.290303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:39.317075 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.317044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.317075 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.317075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.317298 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.317194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzglz\" (UniqueName: \"kubernetes.io/projected/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-kube-api-access-dzglz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.317483 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.317459 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.317548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.317487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.325335 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.325300 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzglz\" (UniqueName: \"kubernetes.io/projected/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-kube-api-access-dzglz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.435318 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.435239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:39.558651 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:39.558632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56"] Jul 07 22:19:39.560654 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:39.560626 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6def3b_b9f3_46e9_a60a_af1e7cbb0b59.slice/crio-917e262489565f2229ecea871f54fd4a288d2a65a1de125e96e7768b3daf2714 WatchSource:0}: Error finding container 917e262489565f2229ecea871f54fd4a288d2a65a1de125e96e7768b3daf2714: Status 404 returned error can't find the container with id 917e262489565f2229ecea871f54fd4a288d2a65a1de125e96e7768b3daf2714 Jul 07 22:19:40.362751 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:40.362724 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerID="2a97589b0d6f21f3bd990e49082130e0210d04c07630cd9b0b8a8e06c0942306" exitCode=0 Jul 07 22:19:40.363103 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:40.362758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" event={"ID":"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59","Type":"ContainerDied","Data":"2a97589b0d6f21f3bd990e49082130e0210d04c07630cd9b0b8a8e06c0942306"} Jul 07 22:19:40.363103 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:40.362793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" event={"ID":"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59","Type":"ContainerStarted","Data":"917e262489565f2229ecea871f54fd4a288d2a65a1de125e96e7768b3daf2714"} Jul 07 22:19:40.405554 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:40.405525 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:41.369213 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:41.369130 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerID="58f0cce6c1c2a6558061cb8f37af080d55b2bc6f9414360cbb477fdd611862e9" exitCode=0 Jul 07 22:19:41.369213 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:41.369182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" event={"ID":"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59","Type":"ContainerDied","Data":"58f0cce6c1c2a6558061cb8f37af080d55b2bc6f9414360cbb477fdd611862e9"} Jul 07 22:19:42.375308 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:42.375269 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerID="1172d3762b1ed86f6da6fce1624237a87394d7ed6169b8893663ec4fd99f92fc" exitCode=0 Jul 07 22:19:42.375692 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:42.375347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" event={"ID":"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59","Type":"ContainerDied","Data":"1172d3762b1ed86f6da6fce1624237a87394d7ed6169b8893663ec4fd99f92fc"} Jul 07 22:19:43.524916 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.524887 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:43.654007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.653921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-util\") pod \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " Jul 07 22:19:43.654007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.653970 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-bundle\") pod \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " Jul 07 22:19:43.654007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.653992 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzglz\" (UniqueName: \"kubernetes.io/projected/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-kube-api-access-dzglz\") pod \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\" (UID: \"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59\") " Jul 07 22:19:43.654797 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.654769 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-bundle" (OuterVolumeSpecName: "bundle") pod "fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" (UID: "fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:19:43.656131 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.656099 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-kube-api-access-dzglz" (OuterVolumeSpecName: "kube-api-access-dzglz") pod "fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" (UID: "fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59"). InnerVolumeSpecName "kube-api-access-dzglz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:19:43.660199 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.660142 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-util" (OuterVolumeSpecName: "util") pod "fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" (UID: "fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:19:43.755409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.755374 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:43.755409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.755402 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:43.755409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:43.755411 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzglz\" (UniqueName: \"kubernetes.io/projected/fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59-kube-api-access-dzglz\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:19:44.340034 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.339995 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jdnqx"] Jul 07 22:19:44.340332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340318 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="extract" Jul 07 22:19:44.340332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340334 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="extract" Jul 07 22:19:44.340433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340348 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="util" Jul 07 22:19:44.340433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340356 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="util" Jul 07 22:19:44.340433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340372 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="pull" Jul 07 22:19:44.340433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340378 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="pull" Jul 07 22:19:44.340540 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.340447 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59" containerName="extract" Jul 07 22:19:44.354328 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.354301 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jdnqx"] Jul 07 22:19:44.354465 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.354392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.356767 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.356742 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l5dd6\"" Jul 07 22:19:44.385977 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.385947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" event={"ID":"fd6def3b-b9f3-46e9-a60a-af1e7cbb0b59","Type":"ContainerDied","Data":"917e262489565f2229ecea871f54fd4a288d2a65a1de125e96e7768b3daf2714"} Jul 07 22:19:44.386105 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.385989 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2sl56" Jul 07 22:19:44.386105 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.385995 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="917e262489565f2229ecea871f54fd4a288d2a65a1de125e96e7768b3daf2714" Jul 07 22:19:44.462319 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.462286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hw6\" (UniqueName: \"kubernetes.io/projected/9cb2f2f3-2151-4251-a230-b9285cf90d09-kube-api-access-j2hw6\") pod \"cert-manager-55b4d954d5-jdnqx\" (UID: \"9cb2f2f3-2151-4251-a230-b9285cf90d09\") " pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.462319 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.462318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb2f2f3-2151-4251-a230-b9285cf90d09-bound-sa-token\") pod \"cert-manager-55b4d954d5-jdnqx\" (UID: \"9cb2f2f3-2151-4251-a230-b9285cf90d09\") " pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.563401 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.563360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hw6\" (UniqueName: \"kubernetes.io/projected/9cb2f2f3-2151-4251-a230-b9285cf90d09-kube-api-access-j2hw6\") pod \"cert-manager-55b4d954d5-jdnqx\" (UID: \"9cb2f2f3-2151-4251-a230-b9285cf90d09\") " pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.563401 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.563403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb2f2f3-2151-4251-a230-b9285cf90d09-bound-sa-token\") pod \"cert-manager-55b4d954d5-jdnqx\" (UID: \"9cb2f2f3-2151-4251-a230-b9285cf90d09\") " pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.571837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.571807 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb2f2f3-2151-4251-a230-b9285cf90d09-bound-sa-token\") pod \"cert-manager-55b4d954d5-jdnqx\" (UID: \"9cb2f2f3-2151-4251-a230-b9285cf90d09\") " pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.572181 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.572164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hw6\" (UniqueName: \"kubernetes.io/projected/9cb2f2f3-2151-4251-a230-b9285cf90d09-kube-api-access-j2hw6\") pod \"cert-manager-55b4d954d5-jdnqx\" (UID: \"9cb2f2f3-2151-4251-a230-b9285cf90d09\") " pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.665444 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.665368 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jdnqx" Jul 07 22:19:44.797237 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:44.797215 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jdnqx"] Jul 07 22:19:44.799641 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:44.799600 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cb2f2f3_2151_4251_a230_b9285cf90d09.slice/crio-55484fdc13c232b2a2809437b765c64e07822ca528157d2a2d7104502c449f04 WatchSource:0}: Error finding container 55484fdc13c232b2a2809437b765c64e07822ca528157d2a2d7104502c449f04: Status 404 returned error can't find the container with id 55484fdc13c232b2a2809437b765c64e07822ca528157d2a2d7104502c449f04 Jul 07 22:19:45.391624 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:45.391587 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jdnqx" event={"ID":"9cb2f2f3-2151-4251-a230-b9285cf90d09","Type":"ContainerStarted","Data":"d5bf756d656353870f59129ac460825387e9d2763bb7334b9092224db9d4da59"} Jul 07 22:19:45.391801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:45.391639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jdnqx" event={"ID":"9cb2f2f3-2151-4251-a230-b9285cf90d09","Type":"ContainerStarted","Data":"55484fdc13c232b2a2809437b765c64e07822ca528157d2a2d7104502c449f04"} Jul 07 22:19:45.409424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:45.409380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jdnqx" podStartSLOduration=1.409366092 podStartE2EDuration="1.409366092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:19:45.407705724 +0000 UTC m=+283.866409398" watchObservedRunningTime="2026-07-07 22:19:45.409366092 +0000 UTC m=+283.868069746" Jul 07 22:19:53.469327 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:53.469294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:53.569860 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:53.569827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.050838 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.050802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.266136 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.266098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.380215 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.380128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.405729 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.405699 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb"] Jul 07 22:19:54.407895 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.407873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.410864 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.410843 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 22:19:54.411058 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.410928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 22:19:54.411506 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.411487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-clx4d\"" Jul 07 22:19:54.411715 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.411573 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 22:19:54.411839 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.411821 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 22:19:54.432374 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.432353 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb"] Jul 07 22:19:54.541513 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.541481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b40c66af-6f09-462b-b758-07491e8d8e65-tmp\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.541892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.541517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b40c66af-6f09-462b-b758-07491e8d8e65-manifests\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.541892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.541549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b40c66af-6f09-462b-b758-07491e8d8e65-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.541892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.541650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b40c66af-6f09-462b-b758-07491e8d8e65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.541892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.541706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x4p6\" (UniqueName: \"kubernetes.io/projected/b40c66af-6f09-462b-b758-07491e8d8e65-kube-api-access-9x4p6\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.546540 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.546509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.642941 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.642853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x4p6\" (UniqueName: \"kubernetes.io/projected/b40c66af-6f09-462b-b758-07491e8d8e65-kube-api-access-9x4p6\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.642941 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.642912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b40c66af-6f09-462b-b758-07491e8d8e65-tmp\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.643168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.642944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b40c66af-6f09-462b-b758-07491e8d8e65-manifests\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.643168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.642976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b40c66af-6f09-462b-b758-07491e8d8e65-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.643168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.643014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b40c66af-6f09-462b-b758-07491e8d8e65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.643502 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.643470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b40c66af-6f09-462b-b758-07491e8d8e65-manifests\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.645499 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.645469 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b40c66af-6f09-462b-b758-07491e8d8e65-tmp\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.645670 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.645646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.645755 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.645669 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b40c66af-6f09-462b-b758-07491e8d8e65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.645755 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.645707 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b40c66af-6f09-462b-b758-07491e8d8e65-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.650155 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.650134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x4p6\" (UniqueName: \"kubernetes.io/projected/b40c66af-6f09-462b-b758-07491e8d8e65-kube-api-access-9x4p6\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb\" (UID: \"b40c66af-6f09-462b-b758-07491e8d8e65\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.718507 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.718473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:19:54.745986 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.745956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.849269 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.849200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb"] Jul 07 22:19:54.851630 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:19:54.851584 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40c66af_6f09_462b_b758_07491e8d8e65.slice/crio-ad00b0e534118c1deb9d2ece26c441e2957ebe3d3e19fc5736964d2ceffa743b WatchSource:0}: Error finding container ad00b0e534118c1deb9d2ece26c441e2957ebe3d3e19fc5736964d2ceffa743b: Status 404 returned error can't find the container with id ad00b0e534118c1deb9d2ece26c441e2957ebe3d3e19fc5736964d2ceffa743b Jul 07 22:19:54.852181 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.852160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:54.946682 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:54.946582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:55.046907 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:55.046870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:55.149468 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:55.149435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:19:55.436256 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:55.436216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" event={"ID":"b40c66af-6f09-462b-b758-07491e8d8e65","Type":"ContainerStarted","Data":"ad00b0e534118c1deb9d2ece26c441e2957ebe3d3e19fc5736964d2ceffa743b"} Jul 07 22:19:58.454728 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:58.454687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" event={"ID":"b40c66af-6f09-462b-b758-07491e8d8e65","Type":"ContainerStarted","Data":"3c1a9ee0e2da0304cf3bb1de7ffbeb69d1bd7690b7ce96f55251b19f4fb8e05c"} Jul 07 22:19:59.459996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:59.459960 2581 generic.go:356] "Generic (PLEG): container finished" podID="b40c66af-6f09-462b-b758-07491e8d8e65" containerID="3c1a9ee0e2da0304cf3bb1de7ffbeb69d1bd7690b7ce96f55251b19f4fb8e05c" exitCode=0 Jul 07 22:19:59.460372 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:19:59.460011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" event={"ID":"b40c66af-6f09-462b-b758-07491e8d8e65","Type":"ContainerDied","Data":"3c1a9ee0e2da0304cf3bb1de7ffbeb69d1bd7690b7ce96f55251b19f4fb8e05c"} Jul 07 22:20:00.466285 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:00.466249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" event={"ID":"b40c66af-6f09-462b-b758-07491e8d8e65","Type":"ContainerStarted","Data":"f127aeebe6fd2e9cb3a21784cc7fc39ef984f0fc37909fd25c04e5c83c8690ad"} Jul 07 22:20:00.466734 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:00.466363 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:20:00.486293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:00.486250 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" podStartSLOduration=2.137521842 podStartE2EDuration="6.486236765s" totalImagesPullingTime="3.264774342s" totalInitContainerRuntime="1.083940581s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:00.485182611 +0000 UTC m=+298.943886279" watchObservedRunningTime="2026-07-07 22:20:00.486236765 +0000 UTC m=+298.944940420" Jul 07 22:20:02.975122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:02.975097 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 22:20:11.472480 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:11.472449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb" Jul 07 22:20:13.073628 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.073585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:13.192840 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.192809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:13.738039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.737998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:13.782883 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.782849 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-776659d659-h6thb"] Jul 07 22:20:13.786823 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.786801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.789881 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.789857 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 22:20:13.790003 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.789980 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 22:20:13.790237 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.790221 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4dhkm\"" Jul 07 22:20:13.790323 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.790308 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 22:20:13.790755 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.790740 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 22:20:13.800811 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.800791 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776659d659-h6thb"] Jul 07 22:20:13.803919 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.803899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbrqp\" (UniqueName: \"kubernetes.io/projected/86dab0ae-3671-49c1-a348-a4889660b724-kube-api-access-wbrqp\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.804039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.803937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86dab0ae-3671-49c1-a348-a4889660b724-tmp\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.804039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.803982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86dab0ae-3671-49c1-a348-a4889660b724-tls-certs\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.889046 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.889010 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4dknx"] Jul 07 22:20:13.893378 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.893353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:13.895993 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.895964 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vg5fm\"" Jul 07 22:20:13.899481 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.899455 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 22:20:13.904399 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.904377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2db\" (UniqueName: \"kubernetes.io/projected/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-kube-api-access-9s2db\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:13.904514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.904434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbrqp\" (UniqueName: \"kubernetes.io/projected/86dab0ae-3671-49c1-a348-a4889660b724-kube-api-access-wbrqp\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.904514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.904470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86dab0ae-3671-49c1-a348-a4889660b724-tmp\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.904514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.904509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-cert\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:13.904706 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.904537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86dab0ae-3671-49c1-a348-a4889660b724-tls-certs\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.904706 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:13.904673 2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 22:20:13.904803 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:13.904737 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86dab0ae-3671-49c1-a348-a4889660b724-tls-certs podName:86dab0ae-3671-49c1-a348-a4889660b724 nodeName:}" failed. No retries permitted until 2026-07-07 22:20:14.404715962 +0000 UTC m=+312.863419595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/86dab0ae-3671-49c1-a348-a4889660b724-tls-certs") pod "kube-auth-proxy-776659d659-h6thb" (UID: "86dab0ae-3671-49c1-a348-a4889660b724") : secret "kube-auth-proxy-tls" not found Jul 07 22:20:13.905954 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.905929 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4dknx"] Jul 07 22:20:13.907131 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.907111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86dab0ae-3671-49c1-a348-a4889660b724-tmp\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:13.930545 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:13.930519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbrqp\" (UniqueName: \"kubernetes.io/projected/86dab0ae-3671-49c1-a348-a4889660b724-kube-api-access-wbrqp\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:14.005774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.005694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2db\" (UniqueName: \"kubernetes.io/projected/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-kube-api-access-9s2db\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:14.005774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.005771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-cert\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:14.005946 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:14.005913 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 22:20:14.005982 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:14.005974 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-cert podName:33c08d12-ed40-4aaa-b47f-bb24ebba3ff7 nodeName:}" failed. No retries permitted until 2026-07-07 22:20:14.505958591 +0000 UTC m=+312.964662224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-cert") pod "odh-model-controller-7998c67dc4-4dknx" (UID: "33c08d12-ed40-4aaa-b47f-bb24ebba3ff7") : secret "odh-model-controller-webhook-cert" not found Jul 07 22:20:14.028758 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.028725 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2db\" (UniqueName: \"kubernetes.io/projected/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-kube-api-access-9s2db\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:14.029904 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.029878 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:14.119335 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.119303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:14.256631 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.256539 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:14.364721 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.364692 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:14.409571 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.409545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86dab0ae-3671-49c1-a348-a4889660b724-tls-certs\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:14.412032 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.412015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86dab0ae-3671-49c1-a348-a4889660b724-tls-certs\") pod \"kube-auth-proxy-776659d659-h6thb\" (UID: \"86dab0ae-3671-49c1-a348-a4889660b724\") " pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:14.510379 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.510289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-cert\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:14.512591 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.512569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33c08d12-ed40-4aaa-b47f-bb24ebba3ff7-cert\") pod \"odh-model-controller-7998c67dc4-4dknx\" (UID: \"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:14.696444 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.696406 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" Jul 07 22:20:14.803984 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.803952 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:14.832546 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.832520 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776659d659-h6thb"] Jul 07 22:20:14.834484 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:20:14.834447 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dab0ae_3671_49c1_a348_a4889660b724.slice/crio-c68a03259ac3898374465bc0674afc03eca8dda0a129186fe67d15181768b782 WatchSource:0}: Error finding container c68a03259ac3898374465bc0674afc03eca8dda0a129186fe67d15181768b782: Status 404 returned error can't find the container with id c68a03259ac3898374465bc0674afc03eca8dda0a129186fe67d15181768b782 Jul 07 22:20:14.836426 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.836407 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 22:20:14.949455 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:14.949424 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4dknx"] Jul 07 22:20:14.952538 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:20:14.952501 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c08d12_ed40_4aaa_b47f_bb24ebba3ff7.slice/crio-208c7ed9c906c4e216cdbdcee8ae4dbb50f61c8eb1c570fa730a0e6c8e89b783 WatchSource:0}: Error finding container 208c7ed9c906c4e216cdbdcee8ae4dbb50f61c8eb1c570fa730a0e6c8e89b783: Status 404 returned error can't find the container with id 208c7ed9c906c4e216cdbdcee8ae4dbb50f61c8eb1c570fa730a0e6c8e89b783 Jul 07 22:20:15.026852 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.026812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:15.093500 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.093422 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qbw47"] Jul 07 22:20:15.098565 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.098544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.101808 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.101789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 22:20:15.101938 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.101809 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 22:20:15.101938 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.101865 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8d856\"" Jul 07 22:20:15.102179 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.102157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 22:20:15.102291 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.102197 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 22:20:15.110978 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.110906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qbw47"] Jul 07 22:20:15.115196 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.115307 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.115307 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc41eb-5e40-4136-9c7b-788bc0be1972-local-certs\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.115423 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zxk\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-kube-api-access-22zxk\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.115423 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-token\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.115423 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-cacerts\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.115537 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.115428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.126535 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.126514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:15.190260 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.190225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:15.216419 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-cacerts\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.216557 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.216557 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.216557 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.216804 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc41eb-5e40-4136-9c7b-788bc0be1972-local-certs\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.216804 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22zxk\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-kube-api-access-22zxk\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.216804 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.216716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-token\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.217186 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.217162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.219018 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.218990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.219018 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.219013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc41eb-5e40-4136-9c7b-788bc0be1972-local-certs\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.219168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.218996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-cacerts\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.219168 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.219060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.231924 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.231896 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-token\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.232147 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.232129 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zxk\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-kube-api-access-22zxk\") pod \"istiod-openshift-gateway-7574459656-qbw47\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.292135 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.292102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:15.408587 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.408501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:15.535347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.535304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" event={"ID":"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7","Type":"ContainerStarted","Data":"208c7ed9c906c4e216cdbdcee8ae4dbb50f61c8eb1c570fa730a0e6c8e89b783"} Jul 07 22:20:15.536755 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.536728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" event={"ID":"86dab0ae-3671-49c1-a348-a4889660b724","Type":"ContainerStarted","Data":"c68a03259ac3898374465bc0674afc03eca8dda0a129186fe67d15181768b782"} Jul 07 22:20:15.549261 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.549231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qbw47"] Jul 07 22:20:15.553134 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:20:15.553109 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecc41eb_5e40_4136_9c7b_788bc0be1972.slice/crio-7868a41e5fed4bdd87bcbd7e924bf16ba65d686d5d68d5f4af1ff8ac12c48514 WatchSource:0}: Error finding container 7868a41e5fed4bdd87bcbd7e924bf16ba65d686d5d68d5f4af1ff8ac12c48514: Status 404 returned error can't find the container with id 7868a41e5fed4bdd87bcbd7e924bf16ba65d686d5d68d5f4af1ff8ac12c48514 Jul 07 22:20:15.964190 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:15.964096 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:16.546135 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:16.546081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" event={"ID":"fecc41eb-5e40-4136-9c7b-788bc0be1972","Type":"ContainerStarted","Data":"7868a41e5fed4bdd87bcbd7e924bf16ba65d686d5d68d5f4af1ff8ac12c48514"} Jul 07 22:20:18.443807 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:18.443738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:18.532101 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:18.532063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:19.817041 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:19.817005 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 22:20:19.817353 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:19.817069 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 22:20:20.566930 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.566889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" event={"ID":"86dab0ae-3671-49c1-a348-a4889660b724","Type":"ContainerStarted","Data":"79264bc296acfc47edae1ebfb3e396fada37143b3175fbc272415a7c59721f46"} Jul 07 22:20:20.568419 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.568388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" event={"ID":"fecc41eb-5e40-4136-9c7b-788bc0be1972","Type":"ContainerStarted","Data":"66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad"} Jul 07 22:20:20.568581 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.568432 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:20.570045 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.570018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" event={"ID":"33c08d12-ed40-4aaa-b47f-bb24ebba3ff7","Type":"ContainerStarted","Data":"62e4258ff252c44c98bd1da942f472859cbab5fcc6f81d30834b89a4a7d3ef21"} Jul 07 22:20:20.570211 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.570197 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:20.570514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.570492 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qbw47 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 22:20:20.570639 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.570532 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 22:20:20.594783 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.594729 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-776659d659-h6thb" podStartSLOduration=2.617555328 podStartE2EDuration="7.594709928s" totalImagesPullingTime="4.9771546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:20.593907992 +0000 UTC m=+319.052611664" watchObservedRunningTime="2026-07-07 22:20:20.594709928 +0000 UTC m=+319.053413586" Jul 07 22:20:20.622694 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.622647 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" podStartSLOduration=2.766832782 podStartE2EDuration="7.622634238s" totalImagesPullingTime="4.855801456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:20.621719239 +0000 UTC m=+319.080422895" watchObservedRunningTime="2026-07-07 22:20:20.622634238 +0000 UTC m=+319.081337893" Jul 07 22:20:20.656194 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.656139 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" podStartSLOduration=1.394632696 podStartE2EDuration="5.656120176s" totalImagesPullingTime="4.26148748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:20.655461956 +0000 UTC m=+319.114165609" watchObservedRunningTime="2026-07-07 22:20:20.656120176 +0000 UTC m=+319.114823830" Jul 07 22:20:20.815501 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.815464 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:20.915721 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:20.915631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:21.442117 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.442078 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6"] Jul 07 22:20:21.445723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.445705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.457209 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.457184 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6"] Jul 07 22:20:21.485481 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.485661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.485661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.485661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pkl5\" (UniqueName: \"kubernetes.io/projected/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-kube-api-access-5pkl5\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.485825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.485825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.485825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.485799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.530672 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.530637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:21.574996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.574965 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qbw47 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 22:20:21.575151 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.575030 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 22:20:21.586545 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.586706 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.586760 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.586806 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pkl5\" (UniqueName: \"kubernetes.io/projected/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-kube-api-access-5pkl5\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.586858 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.586858 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.586963 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.586865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.587572 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.587546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.589057 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.589030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.589194 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.589117 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.589194 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.589161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.589305 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.589289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.600538 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.600520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.600764 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.600738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pkl5\" (UniqueName: \"kubernetes.io/projected/3d9c656d-4160-4df7-8fdf-b6967ad2b2b7-kube-api-access-5pkl5\") pod \"istiod-openshift-gateway-94bb8fbfd-545d6\" (UID: \"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.755562 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.755533 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:21.832792 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.832761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:21.892219 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.892195 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6"] Jul 07 22:20:21.894353 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:20:21.894324 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9c656d_4160_4df7_8fdf_b6967ad2b2b7.slice/crio-36e5bd3c0091ec579e946a00a16272a60ee63ec57a33c522d169a1ca5b6d7978 WatchSource:0}: Error finding container 36e5bd3c0091ec579e946a00a16272a60ee63ec57a33c522d169a1ca5b6d7978: Status 404 returned error can't find the container with id 36e5bd3c0091ec579e946a00a16272a60ee63ec57a33c522d169a1ca5b6d7978 Jul 07 22:20:21.897713 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.897683 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 22:20:21.897783 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:21.897741 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 22:20:22.030958 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.030877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:22.580732 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.580693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" event={"ID":"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7","Type":"ContainerStarted","Data":"bd03d25acd7a745cb9eb7806f8eb787c5c2408e6b700a92eb536a3933e84765e"} Jul 07 22:20:22.580911 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.580746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" event={"ID":"3d9c656d-4160-4df7-8fdf-b6967ad2b2b7","Type":"ContainerStarted","Data":"36e5bd3c0091ec579e946a00a16272a60ee63ec57a33c522d169a1ca5b6d7978"} Jul 07 22:20:22.580911 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.580900 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:22.582644 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.582595 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-545d6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 22:20:22.582762 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.582664 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" podUID="3d9c656d-4160-4df7-8fdf-b6967ad2b2b7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 22:20:22.623511 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:22.623459 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" podStartSLOduration=1.623445746 podStartE2EDuration="1.623445746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:22.618120911 +0000 UTC m=+321.076824566" watchObservedRunningTime="2026-07-07 22:20:22.623445746 +0000 UTC m=+321.082149401" Jul 07 22:20:23.591765 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:23.591738 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-545d6" Jul 07 22:20:23.694433 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:23.694401 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qbw47"] Jul 07 22:20:23.694645 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:23.694602 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerName="discovery" containerID="cri-o://66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad" gracePeriod=30 Jul 07 22:20:23.695415 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:23.695312 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:23.952556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:23.952531 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:24.006690 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006660 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-kubeconfig\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.006690 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006700 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-cacerts\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.006954 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006733 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-token\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.006954 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006765 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22zxk\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-kube-api-access-22zxk\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.006954 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-ca-configmap\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.006954 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006925 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc41eb-5e40-4136-9c7b-788bc0be1972-local-certs\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.007143 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.006961 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-dns-cert\") pod \"fecc41eb-5e40-4136-9c7b-788bc0be1972\" (UID: \"fecc41eb-5e40-4136-9c7b-788bc0be1972\") " Jul 07 22:20:24.007362 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.007337 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:20:24.009366 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.009338 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc41eb-5e40-4136-9c7b-788bc0be1972-local-certs" (OuterVolumeSpecName: "local-certs") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:20:24.009478 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.009466 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-kube-api-access-22zxk" (OuterVolumeSpecName: "kube-api-access-22zxk") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "kube-api-access-22zxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:20:24.009563 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.009485 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:20:24.009770 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.009754 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-cacerts" (OuterVolumeSpecName: "cacerts") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:20:24.009837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.009810 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-token" (OuterVolumeSpecName: "istio-token") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:20:24.010026 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.010009 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "fecc41eb-5e40-4136-9c7b-788bc0be1972" (UID: "fecc41eb-5e40-4136-9c7b-788bc0be1972"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:20:24.108649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108596 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-ca-configmap\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.108649 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108645 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc41eb-5e40-4136-9c7b-788bc0be1972-local-certs\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.108849 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108655 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-csr-dns-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.108849 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108670 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-kubeconfig\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.108849 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108681 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fecc41eb-5e40-4136-9c7b-788bc0be1972-cacerts\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.108849 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108689 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-istio-token\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.108849 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.108696 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22zxk\" (UniqueName: \"kubernetes.io/projected/fecc41eb-5e40-4136-9c7b-788bc0be1972-kube-api-access-22zxk\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:20:24.252033 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.252000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:24.304961 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.304931 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w"] Jul 07 22:20:24.305262 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.305250 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerName="discovery" Jul 07 22:20:24.305316 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.305264 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerName="discovery" Jul 07 22:20:24.305349 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.305327 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerName="discovery" Jul 07 22:20:24.308336 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.308316 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.311389 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.311371 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9jwmm\"" Jul 07 22:20:24.311606 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.311583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 22:20:24.321991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.321965 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w"] Jul 07 22:20:24.324632 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.324596 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f"] Jul 07 22:20:24.327731 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.327712 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:24.330312 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.330262 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b44xl\"" Jul 07 22:20:24.330556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.330519 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 22:20:24.341429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.341403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f"] Jul 07 22:20:24.345573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.345550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:24.411555 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.411521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11c8bb22-d6b7-4eea-a144-95b279481f4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:24.411774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.411565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns4kj\" (UniqueName: \"kubernetes.io/projected/b063713b-68a4-49bf-ad39-cf48d8ea7aa4-kube-api-access-ns4kj\") pod \"kserve-controller-manager-d6f4b65b8-b4b8w\" (UID: \"b063713b-68a4-49bf-ad39-cf48d8ea7aa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.411774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.411715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b063713b-68a4-49bf-ad39-cf48d8ea7aa4-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4b8w\" (UID: \"b063713b-68a4-49bf-ad39-cf48d8ea7aa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.411774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.411756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpjt6\" (UniqueName: \"kubernetes.io/projected/11c8bb22-d6b7-4eea-a144-95b279481f4a-kube-api-access-fpjt6\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:24.423714 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.423689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:24.512351 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.512274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11c8bb22-d6b7-4eea-a144-95b279481f4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:24.512351 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.512317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns4kj\" (UniqueName: \"kubernetes.io/projected/b063713b-68a4-49bf-ad39-cf48d8ea7aa4-kube-api-access-ns4kj\") pod \"kserve-controller-manager-d6f4b65b8-b4b8w\" (UID: \"b063713b-68a4-49bf-ad39-cf48d8ea7aa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.512726 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.512355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b063713b-68a4-49bf-ad39-cf48d8ea7aa4-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4b8w\" (UID: \"b063713b-68a4-49bf-ad39-cf48d8ea7aa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.512726 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.512375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpjt6\" (UniqueName: \"kubernetes.io/projected/11c8bb22-d6b7-4eea-a144-95b279481f4a-kube-api-access-fpjt6\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:24.512726 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:24.512421 2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 22:20:24.512726 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:24.512479 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c8bb22-d6b7-4eea-a144-95b279481f4a-cert podName:11c8bb22-d6b7-4eea-a144-95b279481f4a nodeName:}" failed. No retries permitted until 2026-07-07 22:20:25.012463144 +0000 UTC m=+323.471166778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11c8bb22-d6b7-4eea-a144-95b279481f4a-cert") pod "llmisvc-controller-manager-777c6bd7d5-zk48f" (UID: "11c8bb22-d6b7-4eea-a144-95b279481f4a") : secret "llmisvc-webhook-server-cert" not found Jul 07 22:20:24.514825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.514804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b063713b-68a4-49bf-ad39-cf48d8ea7aa4-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4b8w\" (UID: \"b063713b-68a4-49bf-ad39-cf48d8ea7aa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.521064 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.521040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpjt6\" (UniqueName: \"kubernetes.io/projected/11c8bb22-d6b7-4eea-a144-95b279481f4a-kube-api-access-fpjt6\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:24.521193 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.521174 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns4kj\" (UniqueName: \"kubernetes.io/projected/b063713b-68a4-49bf-ad39-cf48d8ea7aa4-kube-api-access-ns4kj\") pod \"kserve-controller-manager-d6f4b65b8-b4b8w\" (UID: \"b063713b-68a4-49bf-ad39-cf48d8ea7aa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.594377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.594347 2581 generic.go:356] "Generic (PLEG): container finished" podID="fecc41eb-5e40-4136-9c7b-788bc0be1972" containerID="66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad" exitCode=0 Jul 07 22:20:24.594802 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.594386 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" Jul 07 22:20:24.594802 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.594442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" event={"ID":"fecc41eb-5e40-4136-9c7b-788bc0be1972","Type":"ContainerDied","Data":"66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad"} Jul 07 22:20:24.594802 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.594489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qbw47" event={"ID":"fecc41eb-5e40-4136-9c7b-788bc0be1972","Type":"ContainerDied","Data":"7868a41e5fed4bdd87bcbd7e924bf16ba65d686d5d68d5f4af1ff8ac12c48514"} Jul 07 22:20:24.594802 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.594511 2581 scope.go:117] "RemoveContainer" containerID="66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad" Jul 07 22:20:24.603261 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.603242 2581 scope.go:117] "RemoveContainer" containerID="66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad" Jul 07 22:20:24.603499 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:20:24.603481 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad\": container with ID starting with 66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad not found: ID does not exist" containerID="66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad" Jul 07 22:20:24.603561 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.603511 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad"} err="failed to get container status \"66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad\": rpc error: code = NotFound desc = could not find container \"66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad\": container with ID starting with 66af2ef3232a39e28629f9303d2649d97198a5b9f59497a6d4f2555bbae85cad not found: ID does not exist" Jul 07 22:20:24.620896 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.620876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:24.631095 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.631075 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qbw47"] Jul 07 22:20:24.649564 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.649525 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qbw47"] Jul 07 22:20:24.747315 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.747288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:24.767105 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:24.767054 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w"] Jul 07 22:20:24.769158 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:20:24.769131 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb063713b_68a4_49bf_ad39_cf48d8ea7aa4.slice/crio-f4054264377f145336cf57993553f3e4555d440319ccedb05641e0b8ee0fd388 WatchSource:0}: Error finding container f4054264377f145336cf57993553f3e4555d440319ccedb05641e0b8ee0fd388: Status 404 returned error can't find the container with id f4054264377f145336cf57993553f3e4555d440319ccedb05641e0b8ee0fd388 Jul 07 22:20:25.017074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.016990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11c8bb22-d6b7-4eea-a144-95b279481f4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:25.019397 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.019374 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11c8bb22-d6b7-4eea-a144-95b279481f4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zk48f\" (UID: \"11c8bb22-d6b7-4eea-a144-95b279481f4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:25.144541 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.144505 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecc41eb-5e40-4136-9c7b-788bc0be1972" path="/var/lib/kubelet/pods/fecc41eb-5e40-4136-9c7b-788bc0be1972/volumes" Jul 07 22:20:25.239019 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.238987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:25.398370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.398348 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f"] Jul 07 22:20:25.400311 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:20:25.400277 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod11c8bb22_d6b7_4eea_a144_95b279481f4a.slice/crio-d9d4f5dadf7acb1f481fb90093594a02c4af1260cccd0b83f468f15acb2fda9a WatchSource:0}: Error finding container d9d4f5dadf7acb1f481fb90093594a02c4af1260cccd0b83f468f15acb2fda9a: Status 404 returned error can't find the container with id d9d4f5dadf7acb1f481fb90093594a02c4af1260cccd0b83f468f15acb2fda9a Jul 07 22:20:25.535770 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.535737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:25.601955 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.601874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" event={"ID":"11c8bb22-d6b7-4eea-a144-95b279481f4a","Type":"ContainerStarted","Data":"d9d4f5dadf7acb1f481fb90093594a02c4af1260cccd0b83f468f15acb2fda9a"} Jul 07 22:20:25.603243 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.603215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" event={"ID":"b063713b-68a4-49bf-ad39-cf48d8ea7aa4","Type":"ContainerStarted","Data":"f4054264377f145336cf57993553f3e4555d440319ccedb05641e0b8ee0fd388"} Jul 07 22:20:25.618173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.618145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:25.681174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:25.681150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:20:28.624445 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:28.624405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" event={"ID":"11c8bb22-d6b7-4eea-a144-95b279481f4a","Type":"ContainerStarted","Data":"d69727416763b003683376011e99a7cba48d747da89fc3dad5ccbb67b621069d"} Jul 07 22:20:28.624943 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:28.624517 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:28.626056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:28.626035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" event={"ID":"b063713b-68a4-49bf-ad39-cf48d8ea7aa4","Type":"ContainerStarted","Data":"5cf4483a503ff0aa1cbf9e4b19d9d9424b54803437ce0cbab2cebe6ca8af1035"} Jul 07 22:20:28.626179 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:28.626158 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:20:28.643089 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:28.643004 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" podStartSLOduration=1.6554641540000001 podStartE2EDuration="4.642989871s" totalImagesPullingTime="2.987525717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:28.64065408 +0000 UTC m=+327.099357745" watchObservedRunningTime="2026-07-07 22:20:28.642989871 +0000 UTC m=+327.101693525" Jul 07 22:20:28.657465 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:28.657422 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" podStartSLOduration=1.042779792 podStartE2EDuration="4.657409173s" totalImagesPullingTime="3.614629381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:28.655630471 +0000 UTC m=+327.114334143" watchObservedRunningTime="2026-07-07 22:20:28.657409173 +0000 UTC m=+327.116112828" Jul 07 22:20:31.576657 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:31.576603 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4dknx" Jul 07 22:20:59.632994 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:59.632922 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zk48f" Jul 07 22:20:59.636244 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:20:59.636225 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4b8w" Jul 07 22:21:05.090987 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:05.090954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:05.145326 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:05.145275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:14.406539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.406498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:14.506062 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.506019 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:14.529286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.529255 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9db7"] Jul 07 22:21:14.534692 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.534666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:14.537211 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.537192 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 22:21:14.537962 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.537945 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 22:21:14.538081 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.537947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4p6fw\"" Jul 07 22:21:14.544691 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.544668 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9db7"] Jul 07 22:21:14.612329 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.612284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:14.633773 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.633743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/5c7a8487-a833-4146-acf4-562968993dc4-kube-api-access-t98rk\") pod \"kuadrant-operator-catalog-v9db7\" (UID: \"5c7a8487-a833-4146-acf4-562968993dc4\") " pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:14.734410 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.734318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/5c7a8487-a833-4146-acf4-562968993dc4-kube-api-access-t98rk\") pod \"kuadrant-operator-catalog-v9db7\" (UID: \"5c7a8487-a833-4146-acf4-562968993dc4\") " pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:14.742255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.742232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/5c7a8487-a833-4146-acf4-562968993dc4-kube-api-access-t98rk\") pod \"kuadrant-operator-catalog-v9db7\" (UID: \"5c7a8487-a833-4146-acf4-562968993dc4\") " pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:14.846985 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.846951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:14.899254 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.899223 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9db7"] Jul 07 22:21:14.974021 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:14.973996 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9db7"] Jul 07 22:21:14.976100 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:14.976075 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7a8487_a833_4146_acf4_562968993dc4.slice/crio-80c3c32bca336345c02dc22aed06dcf0e88b982c69a9d43419c16b04f02bc247 WatchSource:0}: Error finding container 80c3c32bca336345c02dc22aed06dcf0e88b982c69a9d43419c16b04f02bc247: Status 404 returned error can't find the container with id 80c3c32bca336345c02dc22aed06dcf0e88b982c69a9d43419c16b04f02bc247 Jul 07 22:21:15.108459 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.108429 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4t69r"] Jul 07 22:21:15.111796 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.111780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:15.119571 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.119547 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4t69r"] Jul 07 22:21:15.138302 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.138278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm7kj\" (UniqueName: \"kubernetes.io/projected/ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05-kube-api-access-sm7kj\") pod \"kuadrant-operator-catalog-4t69r\" (UID: \"ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05\") " pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:15.238709 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.238668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm7kj\" (UniqueName: \"kubernetes.io/projected/ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05-kube-api-access-sm7kj\") pod \"kuadrant-operator-catalog-4t69r\" (UID: \"ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05\") " pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:15.246902 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.246875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm7kj\" (UniqueName: \"kubernetes.io/projected/ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05-kube-api-access-sm7kj\") pod \"kuadrant-operator-catalog-4t69r\" (UID: \"ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05\") " pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:15.330373 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.330338 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:15.422576 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.422488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:15.534132 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.534094 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:15.564153 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.564119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4t69r"] Jul 07 22:21:15.610120 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:15.610087 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2f2679_cdc3_4bf7_a210_8beb3a3ffd05.slice/crio-683067007b1a2cb95a911a5d67aef263775b0e3cde5e35ccbe3c3fd8afead268 WatchSource:0}: Error finding container 683067007b1a2cb95a911a5d67aef263775b0e3cde5e35ccbe3c3fd8afead268: Status 404 returned error can't find the container with id 683067007b1a2cb95a911a5d67aef263775b0e3cde5e35ccbe3c3fd8afead268 Jul 07 22:21:15.862943 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.862901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" event={"ID":"5c7a8487-a833-4146-acf4-562968993dc4","Type":"ContainerStarted","Data":"80c3c32bca336345c02dc22aed06dcf0e88b982c69a9d43419c16b04f02bc247"} Jul 07 22:21:15.864218 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:15.864193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" event={"ID":"ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05","Type":"ContainerStarted","Data":"683067007b1a2cb95a911a5d67aef263775b0e3cde5e35ccbe3c3fd8afead268"} Jul 07 22:21:17.876917 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:17.876867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" event={"ID":"5c7a8487-a833-4146-acf4-562968993dc4","Type":"ContainerStarted","Data":"fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649"} Jul 07 22:21:17.877362 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:17.876959 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" podUID="5c7a8487-a833-4146-acf4-562968993dc4" containerName="registry-server" containerID="cri-o://fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649" gracePeriod=2 Jul 07 22:21:17.878372 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:17.878347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" event={"ID":"ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05","Type":"ContainerStarted","Data":"2ab67b1f21729aac7540335fab97140f99fb105999a77fa0172c577852acb009"} Jul 07 22:21:17.905586 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:17.905542 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" podStartSLOduration=1.702169415 podStartE2EDuration="3.905527531s" totalImagesPullingTime="2.203358116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:21:17.891089614 +0000 UTC m=+376.349793288" watchObservedRunningTime="2026-07-07 22:21:17.905527531 +0000 UTC m=+376.364231185" Jul 07 22:21:17.905724 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:17.905690 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" podStartSLOduration=1.33986544 podStartE2EDuration="2.90568478s" totalImagesPullingTime="1.56581934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:21:17.904314101 +0000 UTC m=+376.363017768" watchObservedRunningTime="2026-07-07 22:21:17.90568478 +0000 UTC m=+376.364388435" Jul 07 22:21:18.127278 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.127216 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:18.164344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.164309 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/5c7a8487-a833-4146-acf4-562968993dc4-kube-api-access-t98rk\") pod \"5c7a8487-a833-4146-acf4-562968993dc4\" (UID: \"5c7a8487-a833-4146-acf4-562968993dc4\") " Jul 07 22:21:18.166490 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.166462 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7a8487-a833-4146-acf4-562968993dc4-kube-api-access-t98rk" (OuterVolumeSpecName: "kube-api-access-t98rk") pod "5c7a8487-a833-4146-acf4-562968993dc4" (UID: "5c7a8487-a833-4146-acf4-562968993dc4"). InnerVolumeSpecName "kube-api-access-t98rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:21:18.265825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.265792 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/5c7a8487-a833-4146-acf4-562968993dc4-kube-api-access-t98rk\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:18.884687 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.884650 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c7a8487-a833-4146-acf4-562968993dc4" containerID="fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649" exitCode=0 Jul 07 22:21:18.885165 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.884697 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" Jul 07 22:21:18.885165 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.884745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" event={"ID":"5c7a8487-a833-4146-acf4-562968993dc4","Type":"ContainerDied","Data":"fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649"} Jul 07 22:21:18.885165 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.884798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9db7" event={"ID":"5c7a8487-a833-4146-acf4-562968993dc4","Type":"ContainerDied","Data":"80c3c32bca336345c02dc22aed06dcf0e88b982c69a9d43419c16b04f02bc247"} Jul 07 22:21:18.885165 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.884823 2581 scope.go:117] "RemoveContainer" containerID="fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649" Jul 07 22:21:18.894701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.894679 2581 scope.go:117] "RemoveContainer" containerID="fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649" Jul 07 22:21:18.894994 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:21:18.894976 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649\": container with ID starting with fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649 not found: ID does not exist" containerID="fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649" Jul 07 22:21:18.895051 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.895002 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649"} err="failed to get container status \"fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649\": rpc error: code = NotFound desc = could not find container \"fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649\": container with ID starting with fcc55c765b225f42ebf9c4546bf8b524a473df7b179052b3a77b2ce6777db649 not found: ID does not exist" Jul 07 22:21:18.905540 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.905518 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9db7"] Jul 07 22:21:18.908795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:18.908773 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9db7"] Jul 07 22:21:19.144365 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:19.144284 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7a8487-a833-4146-acf4-562968993dc4" path="/var/lib/kubelet/pods/5c7a8487-a833-4146-acf4-562968993dc4/volumes" Jul 07 22:21:25.423419 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:25.423385 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:25.423903 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:25.423444 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:25.446483 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:25.446457 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:25.941464 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:25.941437 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4t69r" Jul 07 22:21:30.139888 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.139854 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd"] Jul 07 22:21:30.140332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.140230 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7a8487-a833-4146-acf4-562968993dc4" containerName="registry-server" Jul 07 22:21:30.140332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.140241 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7a8487-a833-4146-acf4-562968993dc4" containerName="registry-server" Jul 07 22:21:30.140332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.140304 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7a8487-a833-4146-acf4-562968993dc4" containerName="registry-server" Jul 07 22:21:30.143553 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.143536 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.146096 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.146075 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f55xt\"" Jul 07 22:21:30.150994 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.150972 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd"] Jul 07 22:21:30.267195 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.267159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.267195 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.267199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cctr\" (UniqueName: \"kubernetes.io/projected/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-kube-api-access-8cctr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.267476 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.267340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.368246 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.368208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.368444 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.368261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.368444 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.368283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cctr\" (UniqueName: \"kubernetes.io/projected/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-kube-api-access-8cctr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.368701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.368679 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.368774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.368757 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.376544 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.376516 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cctr\" (UniqueName: \"kubernetes.io/projected/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-kube-api-access-8cctr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.453749 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.453657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:30.590963 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.590939 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd"] Jul 07 22:21:30.596332 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:30.596298 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fb116f_fc1f_45e8_ad0c_47875fa2a6cd.slice/crio-7d14b2057a08b1a2bcce21a746b6783d99a16a8e58fe5d97fa408dafaf8c2019 WatchSource:0}: Error finding container 7d14b2057a08b1a2bcce21a746b6783d99a16a8e58fe5d97fa408dafaf8c2019: Status 404 returned error can't find the container with id 7d14b2057a08b1a2bcce21a746b6783d99a16a8e58fe5d97fa408dafaf8c2019 Jul 07 22:21:30.744217 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.744180 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr"] Jul 07 22:21:30.748154 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.748132 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.755850 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.755822 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr"] Jul 07 22:21:30.873707 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.873666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.873707 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.873711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvf4h\" (UniqueName: \"kubernetes.io/projected/7ace4843-1901-4efc-8ad6-5733cb65a0ce-kube-api-access-rvf4h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.873945 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.873786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.945446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.945402 2581 generic.go:356] "Generic (PLEG): container finished" podID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerID="d621cc9ad0f9718221828e53d5b6da1ed10444e155c9194f90163ebfa71043a6" exitCode=0 Jul 07 22:21:30.945641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.945489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" event={"ID":"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd","Type":"ContainerDied","Data":"d621cc9ad0f9718221828e53d5b6da1ed10444e155c9194f90163ebfa71043a6"} Jul 07 22:21:30.945641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.945544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" event={"ID":"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd","Type":"ContainerStarted","Data":"7d14b2057a08b1a2bcce21a746b6783d99a16a8e58fe5d97fa408dafaf8c2019"} Jul 07 22:21:30.974922 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.974880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.974922 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.974927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvf4h\" (UniqueName: \"kubernetes.io/projected/7ace4843-1901-4efc-8ad6-5733cb65a0ce-kube-api-access-rvf4h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.975189 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.974967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.975346 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.975324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.975415 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.975346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:30.982847 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:30.982822 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvf4h\" (UniqueName: \"kubernetes.io/projected/7ace4843-1901-4efc-8ad6-5733cb65a0ce-kube-api-access-rvf4h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:31.070935 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.070841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:31.146504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.146475 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f"] Jul 07 22:21:31.151191 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.151161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.153800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.153774 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f"] Jul 07 22:21:31.212359 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.212334 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr"] Jul 07 22:21:31.214257 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:31.214227 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ace4843_1901_4efc_8ad6_5733cb65a0ce.slice/crio-49da291830b0cb9a14ef063e668113cdb80faa56dd6d3a8c7ae1d57a29817789 WatchSource:0}: Error finding container 49da291830b0cb9a14ef063e668113cdb80faa56dd6d3a8c7ae1d57a29817789: Status 404 returned error can't find the container with id 49da291830b0cb9a14ef063e668113cdb80faa56dd6d3a8c7ae1d57a29817789 Jul 07 22:21:31.278053 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.278019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.278171 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.278071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw8s4\" (UniqueName: \"kubernetes.io/projected/e71f36f8-e9d7-4481-a18c-30d696a0860d-kube-api-access-cw8s4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.278171 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.278108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.378979 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.378898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.378979 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.378943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw8s4\" (UniqueName: \"kubernetes.io/projected/e71f36f8-e9d7-4481-a18c-30d696a0860d-kube-api-access-cw8s4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.379153 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.379046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.379441 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.379419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.379485 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.379428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.387193 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.387163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw8s4\" (UniqueName: \"kubernetes.io/projected/e71f36f8-e9d7-4481-a18c-30d696a0860d-kube-api-access-cw8s4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.462297 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.462259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:31.542351 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.542313 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq"] Jul 07 22:21:31.547325 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.547301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.556237 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.556201 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq"] Jul 07 22:21:31.604102 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.604075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f"] Jul 07 22:21:31.605641 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:31.605594 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71f36f8_e9d7_4481_a18c_30d696a0860d.slice/crio-2d081a8a4687d09c2ef524a6ea4fa678bea10dacfca21256fb624e66f34cbfb3 WatchSource:0}: Error finding container 2d081a8a4687d09c2ef524a6ea4fa678bea10dacfca21256fb624e66f34cbfb3: Status 404 returned error can't find the container with id 2d081a8a4687d09c2ef524a6ea4fa678bea10dacfca21256fb624e66f34cbfb3 Jul 07 22:21:31.682383 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.682354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.682534 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.682401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.682534 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.682460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f8v5\" (UniqueName: \"kubernetes.io/projected/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-kube-api-access-4f8v5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.783828 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.783783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.784007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.783850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.784007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.783872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f8v5\" (UniqueName: \"kubernetes.io/projected/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-kube-api-access-4f8v5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.784137 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.784111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.784226 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.784205 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.792251 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.792229 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f8v5\" (UniqueName: \"kubernetes.io/projected/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-kube-api-access-4f8v5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.863246 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.863219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:31.959383 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.959326 2581 generic.go:356] "Generic (PLEG): container finished" podID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerID="3a9f4fcebcdc4afcd43fdf3405b091d204de4240eed388d9f96ab948e8952c9b" exitCode=0 Jul 07 22:21:31.959548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.959452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" event={"ID":"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd","Type":"ContainerDied","Data":"3a9f4fcebcdc4afcd43fdf3405b091d204de4240eed388d9f96ab948e8952c9b"} Jul 07 22:21:31.961716 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.961676 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerID="fa0eb9538fd2028959738d5ced544966d0715da88a874ed51bb597976a276275" exitCode=0 Jul 07 22:21:31.961891 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.961789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" event={"ID":"e71f36f8-e9d7-4481-a18c-30d696a0860d","Type":"ContainerDied","Data":"fa0eb9538fd2028959738d5ced544966d0715da88a874ed51bb597976a276275"} Jul 07 22:21:31.961891 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.961841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" event={"ID":"e71f36f8-e9d7-4481-a18c-30d696a0860d","Type":"ContainerStarted","Data":"2d081a8a4687d09c2ef524a6ea4fa678bea10dacfca21256fb624e66f34cbfb3"} Jul 07 22:21:31.963871 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.963840 2581 generic.go:356] "Generic (PLEG): container finished" podID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerID="48521d773b0bfc1373b3bed12f11ea897b36a609fb8480596783d34495807c60" exitCode=0 Jul 07 22:21:31.963974 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.963953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" event={"ID":"7ace4843-1901-4efc-8ad6-5733cb65a0ce","Type":"ContainerDied","Data":"48521d773b0bfc1373b3bed12f11ea897b36a609fb8480596783d34495807c60"} Jul 07 22:21:31.964035 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:31.963993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" event={"ID":"7ace4843-1901-4efc-8ad6-5733cb65a0ce","Type":"ContainerStarted","Data":"49da291830b0cb9a14ef063e668113cdb80faa56dd6d3a8c7ae1d57a29817789"} Jul 07 22:21:32.029675 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.029600 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq"] Jul 07 22:21:32.031698 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:32.031676 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1d7a83_ed51_4fd5_ae4c_05d331d72376.slice/crio-dae246c1db5d3dfa62fb68d6294bb06e95e8bfa8c6d38388025a83f3668d39af WatchSource:0}: Error finding container dae246c1db5d3dfa62fb68d6294bb06e95e8bfa8c6d38388025a83f3668d39af: Status 404 returned error can't find the container with id dae246c1db5d3dfa62fb68d6294bb06e95e8bfa8c6d38388025a83f3668d39af Jul 07 22:21:32.969881 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.969855 2581 generic.go:356] "Generic (PLEG): container finished" podID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerID="593f8f21ad84066e765b2b0947b4dd210a74d827d924b5e9c4574ec7bdc39410" exitCode=0 Jul 07 22:21:32.970268 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.969928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" event={"ID":"7ace4843-1901-4efc-8ad6-5733cb65a0ce","Type":"ContainerDied","Data":"593f8f21ad84066e765b2b0947b4dd210a74d827d924b5e9c4574ec7bdc39410"} Jul 07 22:21:32.971640 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.971606 2581 generic.go:356] "Generic (PLEG): container finished" podID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerID="192e4912829ddbee2fd0a5b266ae62de473a66093faa54f9ce101d6e3f3db5dd" exitCode=0 Jul 07 22:21:32.971740 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.971695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" event={"ID":"bb1d7a83-ed51-4fd5-ae4c-05d331d72376","Type":"ContainerDied","Data":"192e4912829ddbee2fd0a5b266ae62de473a66093faa54f9ce101d6e3f3db5dd"} Jul 07 22:21:32.971740 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.971736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" event={"ID":"bb1d7a83-ed51-4fd5-ae4c-05d331d72376","Type":"ContainerStarted","Data":"dae246c1db5d3dfa62fb68d6294bb06e95e8bfa8c6d38388025a83f3668d39af"} Jul 07 22:21:32.974192 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.974113 2581 generic.go:356] "Generic (PLEG): container finished" podID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerID="afa87d4e75b3d9584caa4673af13033974e224ad5d0a67b718695797e5242c51" exitCode=0 Jul 07 22:21:32.974256 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.974194 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" event={"ID":"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd","Type":"ContainerDied","Data":"afa87d4e75b3d9584caa4673af13033974e224ad5d0a67b718695797e5242c51"} Jul 07 22:21:32.976106 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.976088 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerID="5a7d08c2da48dd2d1a13811590273201522e00608709c1befc29b29cdcf18a0e" exitCode=0 Jul 07 22:21:32.976183 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:32.976129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" event={"ID":"e71f36f8-e9d7-4481-a18c-30d696a0860d","Type":"ContainerDied","Data":"5a7d08c2da48dd2d1a13811590273201522e00608709c1befc29b29cdcf18a0e"} Jul 07 22:21:33.983255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:33.983157 2581 generic.go:356] "Generic (PLEG): container finished" podID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerID="8eb54f1487a762f934d8914116b3a31993adc27bcccd20cb65ca78fddbccaaff" exitCode=0 Jul 07 22:21:33.983255 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:33.983227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" event={"ID":"7ace4843-1901-4efc-8ad6-5733cb65a0ce","Type":"ContainerDied","Data":"8eb54f1487a762f934d8914116b3a31993adc27bcccd20cb65ca78fddbccaaff"} Jul 07 22:21:33.985220 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:33.985195 2581 generic.go:356] "Generic (PLEG): container finished" podID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerID="1972a17103692ac58566ab6088aba8e28419ffc4ad067c45706974edf0883eac" exitCode=0 Jul 07 22:21:33.985361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:33.985280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" event={"ID":"bb1d7a83-ed51-4fd5-ae4c-05d331d72376","Type":"ContainerDied","Data":"1972a17103692ac58566ab6088aba8e28419ffc4ad067c45706974edf0883eac"} Jul 07 22:21:33.987703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:33.987682 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerID="89d674f653aa24ceb40adeff58fd3a1f756809edc7bca713f296b68b37c241da" exitCode=0 Jul 07 22:21:33.987837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:33.987729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" event={"ID":"e71f36f8-e9d7-4481-a18c-30d696a0860d","Type":"ContainerDied","Data":"89d674f653aa24ceb40adeff58fd3a1f756809edc7bca713f296b68b37c241da"} Jul 07 22:21:34.118810 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.118786 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:34.204497 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.204470 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cctr\" (UniqueName: \"kubernetes.io/projected/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-kube-api-access-8cctr\") pod \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " Jul 07 22:21:34.204675 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.204554 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-util\") pod \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " Jul 07 22:21:34.204675 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.204587 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-bundle\") pod \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\" (UID: \"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd\") " Jul 07 22:21:34.205197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.205160 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-bundle" (OuterVolumeSpecName: "bundle") pod "09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" (UID: "09fb116f-fc1f-45e8-ad0c-47875fa2a6cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:34.206556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.206528 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-kube-api-access-8cctr" (OuterVolumeSpecName: "kube-api-access-8cctr") pod "09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" (UID: "09fb116f-fc1f-45e8-ad0c-47875fa2a6cd"). InnerVolumeSpecName "kube-api-access-8cctr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:21:34.209762 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.209744 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-util" (OuterVolumeSpecName: "util") pod "09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" (UID: "09fb116f-fc1f-45e8-ad0c-47875fa2a6cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:34.306286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.306258 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:34.306286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.306282 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:34.306286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.306290 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cctr\" (UniqueName: \"kubernetes.io/projected/09fb116f-fc1f-45e8-ad0c-47875fa2a6cd-kube-api-access-8cctr\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:34.995339 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.995306 2581 generic.go:356] "Generic (PLEG): container finished" podID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerID="f557715faa1b0f4e92ba73f8989d15484bd40aec1124e50d0a1a0fc43674409a" exitCode=0 Jul 07 22:21:34.995848 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.995388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" event={"ID":"bb1d7a83-ed51-4fd5-ae4c-05d331d72376","Type":"ContainerDied","Data":"f557715faa1b0f4e92ba73f8989d15484bd40aec1124e50d0a1a0fc43674409a"} Jul 07 22:21:34.997311 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.997295 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" Jul 07 22:21:34.997424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.997334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd" event={"ID":"09fb116f-fc1f-45e8-ad0c-47875fa2a6cd","Type":"ContainerDied","Data":"7d14b2057a08b1a2bcce21a746b6783d99a16a8e58fe5d97fa408dafaf8c2019"} Jul 07 22:21:34.997424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:34.997368 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d14b2057a08b1a2bcce21a746b6783d99a16a8e58fe5d97fa408dafaf8c2019" Jul 07 22:21:35.171763 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.171738 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:35.173757 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.173740 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:35.314999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.314910 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-bundle\") pod \"e71f36f8-e9d7-4481-a18c-30d696a0860d\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " Jul 07 22:21:35.314999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.314968 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-util\") pod \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " Jul 07 22:21:35.314999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.314994 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-bundle\") pod \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " Jul 07 22:21:35.315270 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.315019 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-util\") pod \"e71f36f8-e9d7-4481-a18c-30d696a0860d\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " Jul 07 22:21:35.315270 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.315039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw8s4\" (UniqueName: \"kubernetes.io/projected/e71f36f8-e9d7-4481-a18c-30d696a0860d-kube-api-access-cw8s4\") pod \"e71f36f8-e9d7-4481-a18c-30d696a0860d\" (UID: \"e71f36f8-e9d7-4481-a18c-30d696a0860d\") " Jul 07 22:21:35.315270 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.315074 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvf4h\" (UniqueName: \"kubernetes.io/projected/7ace4843-1901-4efc-8ad6-5733cb65a0ce-kube-api-access-rvf4h\") pod \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\" (UID: \"7ace4843-1901-4efc-8ad6-5733cb65a0ce\") " Jul 07 22:21:35.315552 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.315520 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-bundle" (OuterVolumeSpecName: "bundle") pod "e71f36f8-e9d7-4481-a18c-30d696a0860d" (UID: "e71f36f8-e9d7-4481-a18c-30d696a0860d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:35.315782 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.315751 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-bundle" (OuterVolumeSpecName: "bundle") pod "7ace4843-1901-4efc-8ad6-5733cb65a0ce" (UID: "7ace4843-1901-4efc-8ad6-5733cb65a0ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:35.317243 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.317222 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e71f36f8-e9d7-4481-a18c-30d696a0860d-kube-api-access-cw8s4" (OuterVolumeSpecName: "kube-api-access-cw8s4") pod "e71f36f8-e9d7-4481-a18c-30d696a0860d" (UID: "e71f36f8-e9d7-4481-a18c-30d696a0860d"). InnerVolumeSpecName "kube-api-access-cw8s4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:21:35.317332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.317268 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ace4843-1901-4efc-8ad6-5733cb65a0ce-kube-api-access-rvf4h" (OuterVolumeSpecName: "kube-api-access-rvf4h") pod "7ace4843-1901-4efc-8ad6-5733cb65a0ce" (UID: "7ace4843-1901-4efc-8ad6-5733cb65a0ce"). InnerVolumeSpecName "kube-api-access-rvf4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:21:35.320179 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.320155 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-util" (OuterVolumeSpecName: "util") pod "7ace4843-1901-4efc-8ad6-5733cb65a0ce" (UID: "7ace4843-1901-4efc-8ad6-5733cb65a0ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:35.320686 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.320666 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-util" (OuterVolumeSpecName: "util") pod "e71f36f8-e9d7-4481-a18c-30d696a0860d" (UID: "e71f36f8-e9d7-4481-a18c-30d696a0860d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:35.416393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.416359 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:35.416393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.416387 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:35.416393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.416395 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ace4843-1901-4efc-8ad6-5733cb65a0ce-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:35.416393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.416403 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e71f36f8-e9d7-4481-a18c-30d696a0860d-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:35.416607 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.416411 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw8s4\" (UniqueName: \"kubernetes.io/projected/e71f36f8-e9d7-4481-a18c-30d696a0860d-kube-api-access-cw8s4\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:35.416607 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:35.416420 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvf4h\" (UniqueName: \"kubernetes.io/projected/7ace4843-1901-4efc-8ad6-5733cb65a0ce-kube-api-access-rvf4h\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:36.004716 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.004684 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" Jul 07 22:21:36.004716 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.004699 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f" event={"ID":"e71f36f8-e9d7-4481-a18c-30d696a0860d","Type":"ContainerDied","Data":"2d081a8a4687d09c2ef524a6ea4fa678bea10dacfca21256fb624e66f34cbfb3"} Jul 07 22:21:36.005243 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.004759 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d081a8a4687d09c2ef524a6ea4fa678bea10dacfca21256fb624e66f34cbfb3" Jul 07 22:21:36.006701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.006675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" event={"ID":"7ace4843-1901-4efc-8ad6-5733cb65a0ce","Type":"ContainerDied","Data":"49da291830b0cb9a14ef063e668113cdb80faa56dd6d3a8c7ae1d57a29817789"} Jul 07 22:21:36.006835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.006720 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49da291830b0cb9a14ef063e668113cdb80faa56dd6d3a8c7ae1d57a29817789" Jul 07 22:21:36.006835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.006805 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr" Jul 07 22:21:36.146951 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.146926 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:36.223067 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.223032 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-bundle\") pod \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " Jul 07 22:21:36.223067 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.223074 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-util\") pod \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " Jul 07 22:21:36.223251 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.223134 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f8v5\" (UniqueName: \"kubernetes.io/projected/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-kube-api-access-4f8v5\") pod \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\" (UID: \"bb1d7a83-ed51-4fd5-ae4c-05d331d72376\") " Jul 07 22:21:36.223872 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.223732 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-bundle" (OuterVolumeSpecName: "bundle") pod "bb1d7a83-ed51-4fd5-ae4c-05d331d72376" (UID: "bb1d7a83-ed51-4fd5-ae4c-05d331d72376"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:36.225723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.225696 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-kube-api-access-4f8v5" (OuterVolumeSpecName: "kube-api-access-4f8v5") pod "bb1d7a83-ed51-4fd5-ae4c-05d331d72376" (UID: "bb1d7a83-ed51-4fd5-ae4c-05d331d72376"). InnerVolumeSpecName "kube-api-access-4f8v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:21:36.229569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.229548 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-util" (OuterVolumeSpecName: "util") pod "bb1d7a83-ed51-4fd5-ae4c-05d331d72376" (UID: "bb1d7a83-ed51-4fd5-ae4c-05d331d72376"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:21:36.324692 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.324591 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f8v5\" (UniqueName: \"kubernetes.io/projected/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-kube-api-access-4f8v5\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:36.324692 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.324640 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:36.324692 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:36.324655 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d7a83-ed51-4fd5-ae4c-05d331d72376-util\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:21:37.013453 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:37.013427 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" Jul 07 22:21:37.013856 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:37.013427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq" event={"ID":"bb1d7a83-ed51-4fd5-ae4c-05d331d72376","Type":"ContainerDied","Data":"dae246c1db5d3dfa62fb68d6294bb06e95e8bfa8c6d38388025a83f3668d39af"} Jul 07 22:21:37.013856 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:37.013542 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dae246c1db5d3dfa62fb68d6294bb06e95e8bfa8c6d38388025a83f3668d39af" Jul 07 22:21:37.885966 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:37.885931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:43.510653 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:43.510592 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:46.138831 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.138797 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2"] Jul 07 22:21:46.139197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139150 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="extract" Jul 07 22:21:46.139197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139163 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="extract" Jul 07 22:21:46.139197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139175 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="util" Jul 07 22:21:46.139197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139180 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="util" Jul 07 22:21:46.139197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139189 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="pull" Jul 07 22:21:46.139197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139200 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139208 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="extract" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139213 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="extract" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139224 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="util" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139228 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="util" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139234 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="util" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139239 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="util" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139250 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="util" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139254 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="util" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139260 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139267 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139277 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139284 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139289 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="extract" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139294 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="extract" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139299 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139304 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="pull" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139312 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="extract" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139317 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="extract" Jul 07 22:21:46.139370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139375 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1d7a83-ed51-4fd5-ae4c-05d331d72376" containerName="extract" Jul 07 22:21:46.139906 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139384 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71f36f8-e9d7-4481-a18c-30d696a0860d" containerName="extract" Jul 07 22:21:46.139906 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139390 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="09fb116f-fc1f-45e8-ad0c-47875fa2a6cd" containerName="extract" Jul 07 22:21:46.139906 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.139395 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ace4843-1901-4efc-8ad6-5733cb65a0ce" containerName="extract" Jul 07 22:21:46.142562 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.142534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:21:46.144988 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.144970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pz97q\"" Jul 07 22:21:46.151690 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.151655 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2"] Jul 07 22:21:46.307999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.307961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9kq5\" (UniqueName: \"kubernetes.io/projected/9936f021-b1b6-4394-9517-876cb0a808bc-kube-api-access-r9kq5\") pod \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" (UID: \"9936f021-b1b6-4394-9517-876cb0a808bc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:21:46.409124 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.409006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9kq5\" (UniqueName: \"kubernetes.io/projected/9936f021-b1b6-4394-9517-876cb0a808bc-kube-api-access-r9kq5\") pod \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" (UID: \"9936f021-b1b6-4394-9517-876cb0a808bc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:21:46.423665 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.423637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9kq5\" (UniqueName: \"kubernetes.io/projected/9936f021-b1b6-4394-9517-876cb0a808bc-kube-api-access-r9kq5\") pod \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" (UID: \"9936f021-b1b6-4394-9517-876cb0a808bc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:21:46.455565 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.455531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:21:46.592418 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:46.592391 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2"] Jul 07 22:21:46.594313 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:46.594288 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9936f021_b1b6_4394_9517_876cb0a808bc.slice/crio-8d9800b83a4cb2d0f79a43b2d77628ab5b26b0e9ec6eb0a7c955177fb2072e7a WatchSource:0}: Error finding container 8d9800b83a4cb2d0f79a43b2d77628ab5b26b0e9ec6eb0a7c955177fb2072e7a: Status 404 returned error can't find the container with id 8d9800b83a4cb2d0f79a43b2d77628ab5b26b0e9ec6eb0a7c955177fb2072e7a Jul 07 22:21:47.068173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:47.068134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" event={"ID":"9936f021-b1b6-4394-9517-876cb0a808bc","Type":"ContainerStarted","Data":"8d9800b83a4cb2d0f79a43b2d77628ab5b26b0e9ec6eb0a7c955177fb2072e7a"} Jul 07 22:21:47.112914 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:47.112880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:47.218219 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:47.218190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:49.081608 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:49.081574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" event={"ID":"9936f021-b1b6-4394-9517-876cb0a808bc","Type":"ContainerStarted","Data":"0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f"} Jul 07 22:21:49.082036 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:49.081718 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:21:49.101592 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:49.101543 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" podStartSLOduration=1.544229798 podStartE2EDuration="3.101530685s" totalImagesPullingTime="1.557300887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:21:49.099820643 +0000 UTC m=+407.558524300" watchObservedRunningTime="2026-07-07 22:21:49.101530685 +0000 UTC m=+407.560234340" Jul 07 22:21:51.719340 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:51.719286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:52.149086 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:52.149053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:53.572512 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:53.572475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:55.128733 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:55.128661 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:55.944844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:55.944810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:56.046078 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:56.046030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:57.324313 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.324280 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8"] Jul 07 22:21:57.326629 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.326594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:21:57.328868 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.328844 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 22:21:57.329010 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.328990 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4cfwz\"" Jul 07 22:21:57.337193 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.337172 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8"] Jul 07 22:21:57.403327 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.403290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzr66\" (UniqueName: \"kubernetes.io/projected/49960870-18b9-407c-a498-540ddcee87c8-kube-api-access-wzr66\") pod \"dns-operator-controller-manager-864dd78c4c-bdzv8\" (UID: \"49960870-18b9-407c-a498-540ddcee87c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:21:57.503962 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.503930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr66\" (UniqueName: \"kubernetes.io/projected/49960870-18b9-407c-a498-540ddcee87c8-kube-api-access-wzr66\") pod \"dns-operator-controller-manager-864dd78c4c-bdzv8\" (UID: \"49960870-18b9-407c-a498-540ddcee87c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:21:57.514813 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.514786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzr66\" (UniqueName: \"kubernetes.io/projected/49960870-18b9-407c-a498-540ddcee87c8-kube-api-access-wzr66\") pod \"dns-operator-controller-manager-864dd78c4c-bdzv8\" (UID: \"49960870-18b9-407c-a498-540ddcee87c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:21:57.636955 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.636872 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:21:57.772219 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.772193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8"] Jul 07 22:21:57.774344 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:21:57.774317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49960870_18b9_407c_a498_540ddcee87c8.slice/crio-69e4c1ed118c510dcbbdc8e440bd96f9db34b2b6fb42ee17c46a1994edc83391 WatchSource:0}: Error finding container 69e4c1ed118c510dcbbdc8e440bd96f9db34b2b6fb42ee17c46a1994edc83391: Status 404 returned error can't find the container with id 69e4c1ed118c510dcbbdc8e440bd96f9db34b2b6fb42ee17c46a1994edc83391 Jul 07 22:21:57.944897 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:57.944814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:58.127346 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:58.127310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" event={"ID":"49960870-18b9-407c-a498-540ddcee87c8","Type":"ContainerStarted","Data":"69e4c1ed118c510dcbbdc8e440bd96f9db34b2b6fb42ee17c46a1994edc83391"} Jul 07 22:21:59.359660 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:59.359595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:21:59.460043 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:21:59.460008 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:00.088585 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:00.088562 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:00.140472 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:00.140440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" event={"ID":"49960870-18b9-407c-a498-540ddcee87c8","Type":"ContainerStarted","Data":"6a7ac39d60bbdc145f51d2137395d4eacfb03eb21c0e4dad9637f966b7a4f37d"} Jul 07 22:22:00.140660 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:00.140575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:22:00.156941 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:00.156897 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" podStartSLOduration=0.89858886 podStartE2EDuration="3.156883278s" totalImagesPullingTime="2.258294418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:22:00.154982235 +0000 UTC m=+418.613685910" watchObservedRunningTime="2026-07-07 22:22:00.156883278 +0000 UTC m=+418.615586987" Jul 07 22:22:00.503339 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:00.503308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:00.705035 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:00.705003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:02.714786 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:02.714755 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:02.771975 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:02.771945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:04.384584 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:04.384555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:10.631335 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.631304 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth"] Jul 07 22:22:10.634820 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.634801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.637166 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.637145 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xs4cq\"" Jul 07 22:22:10.646767 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.646744 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth"] Jul 07 22:22:10.690986 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.690948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9dc64-1615-48a6-8520-e8804f156379-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.691160 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.690998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5bms\" (UniqueName: \"kubernetes.io/projected/54c9dc64-1615-48a6-8520-e8804f156379-kube-api-access-g5bms\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.792159 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.792126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9dc64-1615-48a6-8520-e8804f156379-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.792159 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.792170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5bms\" (UniqueName: \"kubernetes.io/projected/54c9dc64-1615-48a6-8520-e8804f156379-kube-api-access-g5bms\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.792530 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.792509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9dc64-1615-48a6-8520-e8804f156379-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.801328 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.801309 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5bms\" (UniqueName: \"kubernetes.io/projected/54c9dc64-1615-48a6-8520-e8804f156379-kube-api-access-g5bms\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:10.944813 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:10.944714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:11.083264 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.083238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth"] Jul 07 22:22:11.085085 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:22:11.085060 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c9dc64_1615_48a6_8520_e8804f156379.slice/crio-7b29c21ffcc1898e4d9e9863318039eed3799df25d480e370d8d353bbc627915 WatchSource:0}: Error finding container 7b29c21ffcc1898e4d9e9863318039eed3799df25d480e370d8d353bbc627915: Status 404 returned error can't find the container with id 7b29c21ffcc1898e4d9e9863318039eed3799df25d480e370d8d353bbc627915 Jul 07 22:22:11.149083 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.149054 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdzv8" Jul 07 22:22:11.197265 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.197177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" event={"ID":"54c9dc64-1615-48a6-8520-e8804f156379","Type":"ContainerStarted","Data":"7b29c21ffcc1898e4d9e9863318039eed3799df25d480e370d8d353bbc627915"} Jul 07 22:22:11.287078 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.287041 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth"] Jul 07 22:22:11.295273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.295243 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth"] Jul 07 22:22:11.356098 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.356064 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2"] Jul 07 22:22:11.356344 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.356297 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" containerName="manager" containerID="cri-o://0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f" gracePeriod=2 Jul 07 22:22:11.361504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.361478 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2"] Jul 07 22:22:11.362530 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:11.362436 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:11.414345 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.414316 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh"] Jul 07 22:22:11.414711 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.414692 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" containerName="manager" Jul 07 22:22:11.414711 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.414710 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" containerName="manager" Jul 07 22:22:11.414843 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.414815 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" containerName="manager" Jul 07 22:22:11.416929 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.416907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:11.417819 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.417790 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:11.420347 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:11.420322 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:11.456279 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.456224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh"] Jul 07 22:22:11.497338 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.497289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hthd9\" (UniqueName: \"kubernetes.io/projected/5b0c763e-b58e-4b12-a689-abe66e5d8e61-kube-api-access-hthd9\") pod \"limitador-operator-controller-manager-859d7b78bd-9jtzh\" (UID: \"5b0c763e-b58e-4b12-a689-abe66e5d8e61\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:11.554911 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.554876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:11.587606 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.587582 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:11.591158 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:11.591128 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:11.598530 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.598508 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9kq5\" (UniqueName: \"kubernetes.io/projected/9936f021-b1b6-4394-9517-876cb0a808bc-kube-api-access-r9kq5\") pod \"9936f021-b1b6-4394-9517-876cb0a808bc\" (UID: \"9936f021-b1b6-4394-9517-876cb0a808bc\") " Jul 07 22:22:11.598679 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.598650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hthd9\" (UniqueName: \"kubernetes.io/projected/5b0c763e-b58e-4b12-a689-abe66e5d8e61-kube-api-access-hthd9\") pod \"limitador-operator-controller-manager-859d7b78bd-9jtzh\" (UID: \"5b0c763e-b58e-4b12-a689-abe66e5d8e61\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:11.601056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.601032 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9936f021-b1b6-4394-9517-876cb0a808bc-kube-api-access-r9kq5" (OuterVolumeSpecName: "kube-api-access-r9kq5") pod "9936f021-b1b6-4394-9517-876cb0a808bc" (UID: "9936f021-b1b6-4394-9517-876cb0a808bc"). InnerVolumeSpecName "kube-api-access-r9kq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:22:11.616999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.616978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hthd9\" (UniqueName: \"kubernetes.io/projected/5b0c763e-b58e-4b12-a689-abe66e5d8e61-kube-api-access-hthd9\") pod \"limitador-operator-controller-manager-859d7b78bd-9jtzh\" (UID: \"5b0c763e-b58e-4b12-a689-abe66e5d8e61\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:11.661003 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.660968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:11.699393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.699358 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9kq5\" (UniqueName: \"kubernetes.io/projected/9936f021-b1b6-4394-9517-876cb0a808bc-kube-api-access-r9kq5\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:22:11.731999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.731912 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:11.890307 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:11.890247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh"] Jul 07 22:22:11.892768 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:22:11.892725 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0c763e_b58e_4b12_a689_abe66e5d8e61.slice/crio-baaff1bff745851c9eb833219570d04d80315895b462a0538efe196f8b3954dd WatchSource:0}: Error finding container baaff1bff745851c9eb833219570d04d80315895b462a0538efe196f8b3954dd: Status 404 returned error can't find the container with id baaff1bff745851c9eb833219570d04d80315895b462a0538efe196f8b3954dd Jul 07 22:22:12.203991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.203953 2581 generic.go:356] "Generic (PLEG): container finished" podID="9936f021-b1b6-4394-9517-876cb0a808bc" containerID="0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f" exitCode=0 Jul 07 22:22:12.204183 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.204018 2581 scope.go:117] "RemoveContainer" containerID="0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f" Jul 07 22:22:12.204183 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.204018 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:12.206360 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.206325 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" event={"ID":"5b0c763e-b58e-4b12-a689-abe66e5d8e61","Type":"ContainerStarted","Data":"c8d2d3232e78a7ddb12039d24532402681b716b0c724aca9913be757fa628c03"} Jul 07 22:22:12.206485 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.206379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" event={"ID":"5b0c763e-b58e-4b12-a689-abe66e5d8e61","Type":"ContainerStarted","Data":"baaff1bff745851c9eb833219570d04d80315895b462a0538efe196f8b3954dd"} Jul 07 22:22:12.206485 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.206437 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:12.206750 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:12.206727 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:12.214683 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.214497 2581 scope.go:117] "RemoveContainer" containerID="0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f" Jul 07 22:22:12.214831 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:12.214806 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f\": container with ID starting with 0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f not found: ID does not exist" containerID="0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f" Jul 07 22:22:12.214923 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.214842 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f"} err="failed to get container status \"0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f\": rpc error: code = NotFound desc = could not find container \"0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f\": container with ID starting with 0e4908e844f7eb8e561e8f94756214922e695afab3030fc5e4b7a6053ecd0f5f not found: ID does not exist" Jul 07 22:22:12.226780 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:12.226753 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:12.227602 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:12.227564 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" podStartSLOduration=1.227551746 podStartE2EDuration="1.227551746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:22:12.224819399 +0000 UTC m=+430.683523072" watchObservedRunningTime="2026-07-07 22:22:12.227551746 +0000 UTC m=+430.686255400" Jul 07 22:22:12.231528 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:12.231503 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:13.144681 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:13.144645 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4pjk2\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4pjk2" Jul 07 22:22:13.147245 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:13.147213 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9936f021-b1b6-4394-9517-876cb0a808bc" path="/var/lib/kubelet/pods/9936f021-b1b6-4394-9517-876cb0a808bc/volumes" Jul 07 22:22:13.773840 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:13.773793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:13.872737 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:13.872700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:16.231983 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.231938 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" podUID="54c9dc64-1615-48a6-8520-e8804f156379" containerName="manager" containerID="cri-o://0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1" gracePeriod=2 Jul 07 22:22:16.473363 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.473338 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:16.475805 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:16.475769 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="54c9dc64-1615-48a6-8520-e8804f156379" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:16.539060 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.539025 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9dc64-1615-48a6-8520-e8804f156379-extensions-socket-volume\") pod \"54c9dc64-1615-48a6-8520-e8804f156379\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " Jul 07 22:22:16.539224 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.539076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5bms\" (UniqueName: \"kubernetes.io/projected/54c9dc64-1615-48a6-8520-e8804f156379-kube-api-access-g5bms\") pod \"54c9dc64-1615-48a6-8520-e8804f156379\" (UID: \"54c9dc64-1615-48a6-8520-e8804f156379\") " Jul 07 22:22:16.539299 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.539276 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c9dc64-1615-48a6-8520-e8804f156379-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "54c9dc64-1615-48a6-8520-e8804f156379" (UID: "54c9dc64-1615-48a6-8520-e8804f156379"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 22:22:16.541039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.541020 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c9dc64-1615-48a6-8520-e8804f156379-kube-api-access-g5bms" (OuterVolumeSpecName: "kube-api-access-g5bms") pod "54c9dc64-1615-48a6-8520-e8804f156379" (UID: "54c9dc64-1615-48a6-8520-e8804f156379"). InnerVolumeSpecName "kube-api-access-g5bms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:22:16.640210 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.640161 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9dc64-1615-48a6-8520-e8804f156379-extensions-socket-volume\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:22:16.640210 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:16.640202 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5bms\" (UniqueName: \"kubernetes.io/projected/54c9dc64-1615-48a6-8520-e8804f156379-kube-api-access-g5bms\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:22:17.144369 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:17.144337 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c9dc64-1615-48a6-8520-e8804f156379" path="/var/lib/kubelet/pods/54c9dc64-1615-48a6-8520-e8804f156379/volumes" Jul 07 22:22:17.238765 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:17.238727 2581 generic.go:356] "Generic (PLEG): container finished" podID="54c9dc64-1615-48a6-8520-e8804f156379" containerID="0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1" exitCode=2 Jul 07 22:22:17.239163 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:17.238775 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:17.239163 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:17.238829 2581 scope.go:117] "RemoveContainer" containerID="0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1" Jul 07 22:22:17.243294 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:17.243267 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-66nth\" is forbidden: User \"system:node:ip-10-0-142-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-33.ec2.internal' and this object" podUID="54c9dc64-1615-48a6-8520-e8804f156379" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-66nth" Jul 07 22:22:17.247797 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:17.247771 2581 scope.go:117] "RemoveContainer" containerID="0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1" Jul 07 22:22:17.248040 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:22:17.248022 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1\": container with ID starting with 0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1 not found: ID does not exist" containerID="0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1" Jul 07 22:22:17.248106 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:17.248053 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1"} err="failed to get container status \"0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1\": rpc error: code = NotFound desc = could not find container \"0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1\": container with ID starting with 0ad9b6186aa6b21ff32bf2add11f637b8309d18f26f86927cb3ffb318115f5d1 not found: ID does not exist" Jul 07 22:22:18.087515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:18.087480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:18.205779 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:18.205748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:18.623544 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:18.623514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:18.686080 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:18.686053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:20.325805 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:20.325766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:20.426743 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:20.426711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:23.215129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:23.215040 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9jtzh" Jul 07 22:22:29.029775 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:29.029735 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:29.139174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:29.139136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:31.548204 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:31.548171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:31.647991 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:31.647956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:35.948110 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:35.948078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:36.030881 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:36.030848 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:38.834400 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:38.834365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:38.893313 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:38.893279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:48.436419 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:48.436372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:48.536691 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:48.536660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:48.636572 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:48.636541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:48.693993 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:48.693912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:50.299960 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:50.299925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:50.353998 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:50.353953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:51.272409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:51.272356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:22:51.406164 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:22:51.406128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:02.501329 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:02.501294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:03.019158 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.019122 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:03.019495 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.019481 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c9dc64-1615-48a6-8520-e8804f156379" containerName="manager" Jul 07 22:23:03.019541 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.019497 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c9dc64-1615-48a6-8520-e8804f156379" containerName="manager" Jul 07 22:23:03.019579 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.019561 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c9dc64-1615-48a6-8520-e8804f156379" containerName="manager" Jul 07 22:23:03.021741 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.021725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.024530 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.024512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f55xt\"" Jul 07 22:23:03.024643 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.024573 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 22:23:03.033165 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.033143 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:03.040901 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.040876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:03.041697 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.041677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92h27\" (UniqueName: \"kubernetes.io/projected/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-kube-api-access-92h27\") pod \"limitador-limitador-64c94fd64f-24zqh\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.041769 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.041712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-config-file\") pod \"limitador-limitador-64c94fd64f-24zqh\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.118650 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.118599 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:03.134393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.134362 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:03.142398 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.142369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92h27\" (UniqueName: \"kubernetes.io/projected/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-kube-api-access-92h27\") pod \"limitador-limitador-64c94fd64f-24zqh\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.142540 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.142413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-config-file\") pod \"limitador-limitador-64c94fd64f-24zqh\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.143039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.143018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-config-file\") pod \"limitador-limitador-64c94fd64f-24zqh\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.150374 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.150348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92h27\" (UniqueName: \"kubernetes.io/projected/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-kube-api-access-92h27\") pod \"limitador-limitador-64c94fd64f-24zqh\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.237770 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.237744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:03.333709 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.333632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:03.467968 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.467947 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:03.469748 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:23:03.469724 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57abb3fc_68a3_4fb2_abfd_5e86cf1f19d6.slice/crio-953064518ff9fbac77bdb1d031d345e0ed45cf12a6c557f0146580aefa1198e2 WatchSource:0}: Error finding container 953064518ff9fbac77bdb1d031d345e0ed45cf12a6c557f0146580aefa1198e2: Status 404 returned error can't find the container with id 953064518ff9fbac77bdb1d031d345e0ed45cf12a6c557f0146580aefa1198e2 Jul 07 22:23:03.496887 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.496856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" event={"ID":"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6","Type":"ContainerStarted","Data":"953064518ff9fbac77bdb1d031d345e0ed45cf12a6c557f0146580aefa1198e2"} Jul 07 22:23:03.840241 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.840207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:03.895078 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:03.895050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:06.516673 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:06.516637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" event={"ID":"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6","Type":"ContainerStarted","Data":"fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67"} Jul 07 22:23:06.517137 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:06.516744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:06.532727 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:06.532681 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" podStartSLOduration=1.039943067 podStartE2EDuration="3.532667767s" totalImagesPullingTime="2.4927247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:23:06.53086602 +0000 UTC m=+484.989569675" watchObservedRunningTime="2026-07-07 22:23:06.532667767 +0000 UTC m=+484.991371422" Jul 07 22:23:17.523574 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:17.523549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:17.851054 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:17.850959 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:17.851246 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:17.851201 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" podUID="57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" containerName="limitador" containerID="cri-o://fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67" gracePeriod=30 Jul 07 22:23:18.393286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.393259 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:18.458166 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.458082 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-config-file\") pod \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " Jul 07 22:23:18.458166 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.458124 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92h27\" (UniqueName: \"kubernetes.io/projected/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-kube-api-access-92h27\") pod \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\" (UID: \"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6\") " Jul 07 22:23:18.458675 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.458436 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-config-file" (OuterVolumeSpecName: "config-file") pod "57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" (UID: "57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:23:18.460181 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.460158 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-kube-api-access-92h27" (OuterVolumeSpecName: "kube-api-access-92h27") pod "57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" (UID: "57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6"). InnerVolumeSpecName "kube-api-access-92h27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:23:18.558678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.558647 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-config-file\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:23:18.558678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.558677 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92h27\" (UniqueName: \"kubernetes.io/projected/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6-kube-api-access-92h27\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:23:18.578428 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.578396 2581 generic.go:356] "Generic (PLEG): container finished" podID="57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" containerID="fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67" exitCode=0 Jul 07 22:23:18.578573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.578449 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" Jul 07 22:23:18.578573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.578481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" event={"ID":"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6","Type":"ContainerDied","Data":"fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67"} Jul 07 22:23:18.578573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.578532 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-24zqh" event={"ID":"57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6","Type":"ContainerDied","Data":"953064518ff9fbac77bdb1d031d345e0ed45cf12a6c557f0146580aefa1198e2"} Jul 07 22:23:18.578573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.578558 2581 scope.go:117] "RemoveContainer" containerID="fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67" Jul 07 22:23:18.587944 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.587926 2581 scope.go:117] "RemoveContainer" containerID="fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67" Jul 07 22:23:18.588179 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:23:18.588162 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67\": container with ID starting with fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67 not found: ID does not exist" containerID="fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67" Jul 07 22:23:18.588270 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.588185 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67"} err="failed to get container status \"fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67\": rpc error: code = NotFound desc = could not find container \"fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67\": container with ID starting with fd3d89c943702a01567a2f7e4d8a084993cbcf39c2520d51dc74f019d9077a67 not found: ID does not exist" Jul 07 22:23:18.598290 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.598268 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:18.601949 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:18.601928 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-24zqh"] Jul 07 22:23:19.145832 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:19.145799 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" path="/var/lib/kubelet/pods/57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6/volumes" Jul 07 22:23:20.320769 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.320738 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-cnj85"] Jul 07 22:23:20.321242 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.321097 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" containerName="limitador" Jul 07 22:23:20.321242 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.321108 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" containerName="limitador" Jul 07 22:23:20.321242 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.321166 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="57abb3fc-68a3-4fb2-abfd-5e86cf1f19d6" containerName="limitador" Jul 07 22:23:20.324099 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.324078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.326364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.326345 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2vn5t\"" Jul 07 22:23:20.326483 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.326370 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 22:23:20.331130 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.331111 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cnj85"] Jul 07 22:23:20.361249 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.361221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:20.371033 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.371014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/106f0e80-98d2-4592-aa5a-c0baa7d6b909-data\") pod \"postgres-69fb4594cf-cnj85\" (UID: \"106f0e80-98d2-4592-aa5a-c0baa7d6b909\") " pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.371125 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.371039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mhc\" (UniqueName: \"kubernetes.io/projected/106f0e80-98d2-4592-aa5a-c0baa7d6b909-kube-api-access-m4mhc\") pod \"postgres-69fb4594cf-cnj85\" (UID: \"106f0e80-98d2-4592-aa5a-c0baa7d6b909\") " pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.471870 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.471835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/106f0e80-98d2-4592-aa5a-c0baa7d6b909-data\") pod \"postgres-69fb4594cf-cnj85\" (UID: \"106f0e80-98d2-4592-aa5a-c0baa7d6b909\") " pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.472046 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.471929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mhc\" (UniqueName: \"kubernetes.io/projected/106f0e80-98d2-4592-aa5a-c0baa7d6b909-kube-api-access-m4mhc\") pod \"postgres-69fb4594cf-cnj85\" (UID: \"106f0e80-98d2-4592-aa5a-c0baa7d6b909\") " pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.472170 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.472154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/106f0e80-98d2-4592-aa5a-c0baa7d6b909-data\") pod \"postgres-69fb4594cf-cnj85\" (UID: \"106f0e80-98d2-4592-aa5a-c0baa7d6b909\") " pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.480214 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.480194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mhc\" (UniqueName: \"kubernetes.io/projected/106f0e80-98d2-4592-aa5a-c0baa7d6b909-kube-api-access-m4mhc\") pod \"postgres-69fb4594cf-cnj85\" (UID: \"106f0e80-98d2-4592-aa5a-c0baa7d6b909\") " pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.637206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.637126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:20.764837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:20.764810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cnj85"] Jul 07 22:23:20.766752 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:23:20.766725 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106f0e80_98d2_4592_aa5a_c0baa7d6b909.slice/crio-ee8654aaab637c0da355b980d894b2027c671fd2f45c1cc10485534014582af6 WatchSource:0}: Error finding container ee8654aaab637c0da355b980d894b2027c671fd2f45c1cc10485534014582af6: Status 404 returned error can't find the container with id ee8654aaab637c0da355b980d894b2027c671fd2f45c1cc10485534014582af6 Jul 07 22:23:21.600155 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:21.600113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cnj85" event={"ID":"106f0e80-98d2-4592-aa5a-c0baa7d6b909","Type":"ContainerStarted","Data":"ee8654aaab637c0da355b980d894b2027c671fd2f45c1cc10485534014582af6"} Jul 07 22:23:25.634203 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:25.634168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cnj85" event={"ID":"106f0e80-98d2-4592-aa5a-c0baa7d6b909","Type":"ContainerStarted","Data":"6100eb72430287dc25530b9d7e1437ab68ffa4df096d0adf922df043f077d51e"} Jul 07 22:23:25.634597 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:25.634285 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:25.649984 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:25.649937 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-cnj85" podStartSLOduration=0.963025032 podStartE2EDuration="5.649923191s" totalImagesPullingTime="4.686898159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:23:25.647931387 +0000 UTC m=+504.106635042" watchObservedRunningTime="2026-07-07 22:23:25.649923191 +0000 UTC m=+504.108626847" Jul 07 22:23:27.162932 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:27.162882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:27.256794 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:27.256757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:31.670173 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:31.670137 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-cnj85" Jul 07 22:23:31.984925 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:31.984822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:32.192428 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.192395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:32.486550 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.486512 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-768597f479-vlfqw"] Jul 07 22:23:32.490503 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.490480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:32.492765 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.492748 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zmqw2\"" Jul 07 22:23:32.497793 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.497739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768597f479-vlfqw"] Jul 07 22:23:32.579391 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.579360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh9l6\" (UniqueName: \"kubernetes.io/projected/519af163-ec6d-49fb-9de8-7d91ace32a5a-kube-api-access-jh9l6\") pod \"authorino-768597f479-vlfqw\" (UID: \"519af163-ec6d-49fb-9de8-7d91ace32a5a\") " pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:32.669797 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.669759 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768597f479-vlfqw"] Jul 07 22:23:32.670032 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:23:32.670015 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jh9l6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-768597f479-vlfqw" podUID="519af163-ec6d-49fb-9de8-7d91ace32a5a" Jul 07 22:23:32.677591 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.677563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:32.679987 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.679967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh9l6\" (UniqueName: \"kubernetes.io/projected/519af163-ec6d-49fb-9de8-7d91ace32a5a-kube-api-access-jh9l6\") pod \"authorino-768597f479-vlfqw\" (UID: \"519af163-ec6d-49fb-9de8-7d91ace32a5a\") " pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:32.683415 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.683395 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:32.693840 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.693820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh9l6\" (UniqueName: \"kubernetes.io/projected/519af163-ec6d-49fb-9de8-7d91ace32a5a-kube-api-access-jh9l6\") pod \"authorino-768597f479-vlfqw\" (UID: \"519af163-ec6d-49fb-9de8-7d91ace32a5a\") " pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:32.780888 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.780803 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh9l6\" (UniqueName: \"kubernetes.io/projected/519af163-ec6d-49fb-9de8-7d91ace32a5a-kube-api-access-jh9l6\") pod \"519af163-ec6d-49fb-9de8-7d91ace32a5a\" (UID: \"519af163-ec6d-49fb-9de8-7d91ace32a5a\") " Jul 07 22:23:32.782864 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.782840 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519af163-ec6d-49fb-9de8-7d91ace32a5a-kube-api-access-jh9l6" (OuterVolumeSpecName: "kube-api-access-jh9l6") pod "519af163-ec6d-49fb-9de8-7d91ace32a5a" (UID: "519af163-ec6d-49fb-9de8-7d91ace32a5a"). InnerVolumeSpecName "kube-api-access-jh9l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:23:32.882245 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:32.882211 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh9l6\" (UniqueName: \"kubernetes.io/projected/519af163-ec6d-49fb-9de8-7d91ace32a5a-kube-api-access-jh9l6\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:23:33.682680 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:33.682643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768597f479-vlfqw" Jul 07 22:23:33.709385 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:33.709353 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768597f479-vlfqw"] Jul 07 22:23:33.713971 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:33.713944 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-768597f479-vlfqw"] Jul 07 22:23:35.144657 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:35.144602 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519af163-ec6d-49fb-9de8-7d91ace32a5a" path="/var/lib/kubelet/pods/519af163-ec6d-49fb-9de8-7d91ace32a5a/volumes" Jul 07 22:23:38.255159 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.255119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:38.270380 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.270352 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-869747c694-pqjd9"] Jul 07 22:23:38.290828 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.290802 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-869747c694-pqjd9"] Jul 07 22:23:38.290996 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.290898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.293361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.293335 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 22:23:38.293361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.293357 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gzwhb\"" Jul 07 22:23:38.293561 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.293366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 22:23:38.326300 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.326266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:38.329405 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.329379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.329540 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.329433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcglb\" (UniqueName: \"kubernetes.io/projected/13c8d79f-4d5d-4e3b-a585-43794693ee48-kube-api-access-dcglb\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.386193 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.386161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:38.430685 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.430647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcglb\" (UniqueName: \"kubernetes.io/projected/13c8d79f-4d5d-4e3b-a585-43794693ee48-kube-api-access-dcglb\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.430857 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.430765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.430939 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:23:38.430920 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 22:23:38.430995 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:23:38.430986 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert podName:13c8d79f-4d5d-4e3b-a585-43794693ee48 nodeName:}" failed. No retries permitted until 2026-07-07 22:23:38.930968227 +0000 UTC m=+517.389671863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert") pod "maas-controller-869747c694-pqjd9" (UID: "13c8d79f-4d5d-4e3b-a585-43794693ee48") : secret "maas-controller-webhook-cert" not found Jul 07 22:23:38.435513 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.435485 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765c58f989-nxgtr"] Jul 07 22:23:38.437835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.437816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.439920 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.439896 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcglb\" (UniqueName: \"kubernetes.io/projected/13c8d79f-4d5d-4e3b-a585-43794693ee48-kube-api-access-dcglb\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.448009 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.447989 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765c58f989-nxgtr"] Jul 07 22:23:38.531324 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.531238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-webhook-cert\") pod \"maas-controller-765c58f989-nxgtr\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.531324 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.531281 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf252\" (UniqueName: \"kubernetes.io/projected/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-kube-api-access-cf252\") pod \"maas-controller-765c58f989-nxgtr\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.601886 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.601843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:38.632373 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.632347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf252\" (UniqueName: \"kubernetes.io/projected/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-kube-api-access-cf252\") pod \"maas-controller-765c58f989-nxgtr\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.632504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.632430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-webhook-cert\") pod \"maas-controller-765c58f989-nxgtr\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.634838 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.634823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-webhook-cert\") pod \"maas-controller-765c58f989-nxgtr\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.639573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.639555 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf252\" (UniqueName: \"kubernetes.io/projected/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-kube-api-access-cf252\") pod \"maas-controller-765c58f989-nxgtr\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.756900 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.756868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:38.887519 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.887496 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765c58f989-nxgtr"] Jul 07 22:23:38.889338 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:23:38.889297 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe94207_9ed9_47e7_9d82_ca4fb232fd5d.slice/crio-d8781612edbd8927cc14e6ef8be4f29da18ad836ae45aeb21995c62577f3d2b5 WatchSource:0}: Error finding container d8781612edbd8927cc14e6ef8be4f29da18ad836ae45aeb21995c62577f3d2b5: Status 404 returned error can't find the container with id d8781612edbd8927cc14e6ef8be4f29da18ad836ae45aeb21995c62577f3d2b5 Jul 07 22:23:38.934923 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.934898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:38.937228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:38.937201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert\") pod \"maas-controller-869747c694-pqjd9\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:39.203211 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:39.203117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:39.335697 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:39.335669 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-869747c694-pqjd9"] Jul 07 22:23:39.337463 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:23:39.337436 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c8d79f_4d5d_4e3b_a585_43794693ee48.slice/crio-a16b61f56cbc985a7fa6ba4fef0934b4d8ac60a88772c0238c31a30bf0fdf1ce WatchSource:0}: Error finding container a16b61f56cbc985a7fa6ba4fef0934b4d8ac60a88772c0238c31a30bf0fdf1ce: Status 404 returned error can't find the container with id a16b61f56cbc985a7fa6ba4fef0934b4d8ac60a88772c0238c31a30bf0fdf1ce Jul 07 22:23:39.714449 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:39.714414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c58f989-nxgtr" event={"ID":"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d","Type":"ContainerStarted","Data":"d8781612edbd8927cc14e6ef8be4f29da18ad836ae45aeb21995c62577f3d2b5"} Jul 07 22:23:39.715544 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:39.715519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869747c694-pqjd9" event={"ID":"13c8d79f-4d5d-4e3b-a585-43794693ee48","Type":"ContainerStarted","Data":"a16b61f56cbc985a7fa6ba4fef0934b4d8ac60a88772c0238c31a30bf0fdf1ce"} Jul 07 22:23:41.508845 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.508751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:41.593935 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.593905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:23:41.730388 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.730355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c58f989-nxgtr" event={"ID":"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d","Type":"ContainerStarted","Data":"7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005"} Jul 07 22:23:41.730569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.730541 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:41.731985 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.731954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869747c694-pqjd9" event={"ID":"13c8d79f-4d5d-4e3b-a585-43794693ee48","Type":"ContainerStarted","Data":"cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0"} Jul 07 22:23:41.732089 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.732004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:41.766564 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.766488 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-765c58f989-nxgtr" podStartSLOduration=1.416626832 podStartE2EDuration="3.766475388s" totalImagesPullingTime="2.349848556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:23:41.763265233 +0000 UTC m=+520.221968908" watchObservedRunningTime="2026-07-07 22:23:41.766475388 +0000 UTC m=+520.225179043" Jul 07 22:23:41.797923 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:41.797880 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-869747c694-pqjd9" podStartSLOduration=1.884589273 podStartE2EDuration="3.797866604s" totalImagesPullingTime="1.913277331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:23:41.796918181 +0000 UTC m=+520.255621849" watchObservedRunningTime="2026-07-07 22:23:41.797866604 +0000 UTC m=+520.256570259" Jul 07 22:23:52.745427 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:52.745397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:23:52.745892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:52.745658 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:52.807479 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:52.807447 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-869747c694-pqjd9"] Jul 07 22:23:52.807676 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:52.807640 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-869747c694-pqjd9" podUID="13c8d79f-4d5d-4e3b-a585-43794693ee48" containerName="manager" containerID="cri-o://cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0" gracePeriod=30 Jul 07 22:23:53.055412 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.055346 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:53.169561 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.169530 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert\") pod \"13c8d79f-4d5d-4e3b-a585-43794693ee48\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " Jul 07 22:23:53.169750 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.169579 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcglb\" (UniqueName: \"kubernetes.io/projected/13c8d79f-4d5d-4e3b-a585-43794693ee48-kube-api-access-dcglb\") pod \"13c8d79f-4d5d-4e3b-a585-43794693ee48\" (UID: \"13c8d79f-4d5d-4e3b-a585-43794693ee48\") " Jul 07 22:23:53.171734 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.171701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "13c8d79f-4d5d-4e3b-a585-43794693ee48" (UID: "13c8d79f-4d5d-4e3b-a585-43794693ee48"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:23:53.171853 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.171790 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c8d79f-4d5d-4e3b-a585-43794693ee48-kube-api-access-dcglb" (OuterVolumeSpecName: "kube-api-access-dcglb") pod "13c8d79f-4d5d-4e3b-a585-43794693ee48" (UID: "13c8d79f-4d5d-4e3b-a585-43794693ee48"). InnerVolumeSpecName "kube-api-access-dcglb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:23:53.270723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.270684 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcglb\" (UniqueName: \"kubernetes.io/projected/13c8d79f-4d5d-4e3b-a585-43794693ee48-kube-api-access-dcglb\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:23:53.270723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.270710 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13c8d79f-4d5d-4e3b-a585-43794693ee48-webhook-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:23:53.800107 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.800070 2581 generic.go:356] "Generic (PLEG): container finished" podID="13c8d79f-4d5d-4e3b-a585-43794693ee48" containerID="cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0" exitCode=0 Jul 07 22:23:53.800536 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.800121 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-869747c694-pqjd9" Jul 07 22:23:53.800536 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.800152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869747c694-pqjd9" event={"ID":"13c8d79f-4d5d-4e3b-a585-43794693ee48","Type":"ContainerDied","Data":"cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0"} Jul 07 22:23:53.800536 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.800203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-869747c694-pqjd9" event={"ID":"13c8d79f-4d5d-4e3b-a585-43794693ee48","Type":"ContainerDied","Data":"a16b61f56cbc985a7fa6ba4fef0934b4d8ac60a88772c0238c31a30bf0fdf1ce"} Jul 07 22:23:53.800536 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.800228 2581 scope.go:117] "RemoveContainer" containerID="cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0" Jul 07 22:23:53.810009 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.809847 2581 scope.go:117] "RemoveContainer" containerID="cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0" Jul 07 22:23:53.810131 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:23:53.810112 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0\": container with ID starting with cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0 not found: ID does not exist" containerID="cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0" Jul 07 22:23:53.810176 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.810139 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0"} err="failed to get container status \"cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0\": rpc error: code = NotFound desc = could not find container \"cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0\": container with ID starting with cfe4ebb68fcda6536b49920b29b68671ca32622a22f1a014550bbf6a1cc4a1b0 not found: ID does not exist" Jul 07 22:23:53.825349 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.825323 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-869747c694-pqjd9"] Jul 07 22:23:53.829384 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:53.829364 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-869747c694-pqjd9"] Jul 07 22:23:55.144787 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:23:55.144751 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c8d79f-4d5d-4e3b-a585-43794693ee48" path="/var/lib/kubelet/pods/13c8d79f-4d5d-4e3b-a585-43794693ee48/volumes" Jul 07 22:24:06.004340 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:06.004298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:06.075059 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:06.075027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:12.428534 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:12.428499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:12.483250 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:12.483218 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:13.110180 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.110136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:13.509231 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.509200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:13.912469 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.912395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:13.989531 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.989495 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7bdf95f944-r4vgw"] Jul 07 22:24:13.989889 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.989874 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c8d79f-4d5d-4e3b-a585-43794693ee48" containerName="manager" Jul 07 22:24:13.989937 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.989891 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c8d79f-4d5d-4e3b-a585-43794693ee48" containerName="manager" Jul 07 22:24:13.989979 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.989962 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c8d79f-4d5d-4e3b-a585-43794693ee48" containerName="manager" Jul 07 22:24:13.993039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.993024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:13.995321 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.995301 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 22:24:13.995417 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:13.995320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-r9rv4\"" Jul 07 22:24:14.021985 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.021958 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bdf95f944-r4vgw"] Jul 07 22:24:14.042681 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.042651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f65d232-63bb-4a09-bff8-fc151eb24fba-maas-api-tls\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.043028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.043001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92nn\" (UniqueName: \"kubernetes.io/projected/2f65d232-63bb-4a09-bff8-fc151eb24fba-kube-api-access-r92nn\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.043140 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.043066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f65d232-63bb-4a09-bff8-fc151eb24fba-openshift-service-ca\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.143758 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.143723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f65d232-63bb-4a09-bff8-fc151eb24fba-openshift-service-ca\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.143964 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.143773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f65d232-63bb-4a09-bff8-fc151eb24fba-maas-api-tls\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.143964 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.143835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r92nn\" (UniqueName: \"kubernetes.io/projected/2f65d232-63bb-4a09-bff8-fc151eb24fba-kube-api-access-r92nn\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.143964 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:24:14.143950 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 07 22:24:14.144135 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:24:14.144024 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f65d232-63bb-4a09-bff8-fc151eb24fba-maas-api-tls podName:2f65d232-63bb-4a09-bff8-fc151eb24fba nodeName:}" failed. No retries permitted until 2026-07-07 22:24:14.644002415 +0000 UTC m=+553.102706054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f65d232-63bb-4a09-bff8-fc151eb24fba-maas-api-tls") pod "maas-api-7bdf95f944-r4vgw" (UID: "2f65d232-63bb-4a09-bff8-fc151eb24fba") : secret "maas-api-serving-cert" not found Jul 07 22:24:14.144321 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.144303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f65d232-63bb-4a09-bff8-fc151eb24fba-openshift-service-ca\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.151773 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.151744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92nn\" (UniqueName: \"kubernetes.io/projected/2f65d232-63bb-4a09-bff8-fc151eb24fba-kube-api-access-r92nn\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.329743 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.329560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:14.413459 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.413429 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:14.414713 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.414686 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-k25kq"] Jul 07 22:24:14.417093 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.417074 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.420159 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.420137 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 22:24:14.420583 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.420416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2n8b5\"" Jul 07 22:24:14.427844 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.427823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-k25kq"] Jul 07 22:24:14.446442 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.446413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbbq\" (UniqueName: \"kubernetes.io/projected/151482dd-1f8e-403f-ab88-35070642257c-kube-api-access-9dbbq\") pod \"payload-pre-processing-7964457696-k25kq\" (UID: \"151482dd-1f8e-403f-ab88-35070642257c\") " pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.446638 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.446479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151482dd-1f8e-403f-ab88-35070642257c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-k25kq\" (UID: \"151482dd-1f8e-403f-ab88-35070642257c\") " pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.452075 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.452053 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-265jt"] Jul 07 22:24:14.454678 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.454664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.471096 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.471071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-265jt"] Jul 07 22:24:14.507951 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.507911 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:14.546988 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.546946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cf1efb-9f34-49bf-a6fb-cd38f4fd1289-plugins-config-volume\") pod \"payload-processing-58f86c7798-265jt\" (UID: \"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289\") " pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.547364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.547014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbbq\" (UniqueName: \"kubernetes.io/projected/151482dd-1f8e-403f-ab88-35070642257c-kube-api-access-9dbbq\") pod \"payload-pre-processing-7964457696-k25kq\" (UID: \"151482dd-1f8e-403f-ab88-35070642257c\") " pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.547364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.547055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqdr\" (UniqueName: \"kubernetes.io/projected/11cf1efb-9f34-49bf-a6fb-cd38f4fd1289-kube-api-access-qcqdr\") pod \"payload-processing-58f86c7798-265jt\" (UID: \"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289\") " pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.547364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.547107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151482dd-1f8e-403f-ab88-35070642257c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-k25kq\" (UID: \"151482dd-1f8e-403f-ab88-35070642257c\") " pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.547941 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.547909 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151482dd-1f8e-403f-ab88-35070642257c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-k25kq\" (UID: \"151482dd-1f8e-403f-ab88-35070642257c\") " pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.554677 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.554651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbbq\" (UniqueName: \"kubernetes.io/projected/151482dd-1f8e-403f-ab88-35070642257c-kube-api-access-9dbbq\") pod \"payload-pre-processing-7964457696-k25kq\" (UID: \"151482dd-1f8e-403f-ab88-35070642257c\") " pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.647791 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.647705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f65d232-63bb-4a09-bff8-fc151eb24fba-maas-api-tls\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.647791 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.647744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cf1efb-9f34-49bf-a6fb-cd38f4fd1289-plugins-config-volume\") pod \"payload-processing-58f86c7798-265jt\" (UID: \"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289\") " pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.647980 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.647793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqdr\" (UniqueName: \"kubernetes.io/projected/11cf1efb-9f34-49bf-a6fb-cd38f4fd1289-kube-api-access-qcqdr\") pod \"payload-processing-58f86c7798-265jt\" (UID: \"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289\") " pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.648517 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.648499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11cf1efb-9f34-49bf-a6fb-cd38f4fd1289-plugins-config-volume\") pod \"payload-processing-58f86c7798-265jt\" (UID: \"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289\") " pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.650212 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.650189 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f65d232-63bb-4a09-bff8-fc151eb24fba-maas-api-tls\") pod \"maas-api-7bdf95f944-r4vgw\" (UID: \"2f65d232-63bb-4a09-bff8-fc151eb24fba\") " pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.654944 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.654918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqdr\" (UniqueName: \"kubernetes.io/projected/11cf1efb-9f34-49bf-a6fb-cd38f4fd1289-kube-api-access-qcqdr\") pod \"payload-processing-58f86c7798-265jt\" (UID: \"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289\") " pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.729034 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.729001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:14.771945 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.771916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:14.873207 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.873177 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-k25kq"] Jul 07 22:24:14.874081 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:24:14.874048 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151482dd_1f8e_403f_ab88_35070642257c.slice/crio-902bae72a596a279d62ffe01cd5ee553e9a38a3530f2dc639c677359fc82bee4 WatchSource:0}: Error finding container 902bae72a596a279d62ffe01cd5ee553e9a38a3530f2dc639c677359fc82bee4: Status 404 returned error can't find the container with id 902bae72a596a279d62ffe01cd5ee553e9a38a3530f2dc639c677359fc82bee4 Jul 07 22:24:14.903099 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.903028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:14.917032 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.917005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" event={"ID":"151482dd-1f8e-403f-ab88-35070642257c","Type":"ContainerStarted","Data":"902bae72a596a279d62ffe01cd5ee553e9a38a3530f2dc639c677359fc82bee4"} Jul 07 22:24:14.917144 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:14.917110 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-265jt"] Jul 07 22:24:14.917891 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:24:14.917868 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cf1efb_9f34_49bf_a6fb_cd38f4fd1289.slice/crio-b7ad5a50a3676befb32547bd0fa0c266e8cc6d0b72ea9a12d7fc7e99ef63ef36 WatchSource:0}: Error finding container b7ad5a50a3676befb32547bd0fa0c266e8cc6d0b72ea9a12d7fc7e99ef63ef36: Status 404 returned error can't find the container with id b7ad5a50a3676befb32547bd0fa0c266e8cc6d0b72ea9a12d7fc7e99ef63ef36 Jul 07 22:24:15.043971 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:15.043942 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bdf95f944-r4vgw"] Jul 07 22:24:15.044724 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:24:15.044689 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f65d232_63bb_4a09_bff8_fc151eb24fba.slice/crio-41e3acd9075c86bf4491674d5e524d6439dfa2fd7905ac5d5a6e2574c5273563 WatchSource:0}: Error finding container 41e3acd9075c86bf4491674d5e524d6439dfa2fd7905ac5d5a6e2574c5273563: Status 404 returned error can't find the container with id 41e3acd9075c86bf4491674d5e524d6439dfa2fd7905ac5d5a6e2574c5273563 Jul 07 22:24:15.926165 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:15.926123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-265jt" event={"ID":"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289","Type":"ContainerStarted","Data":"b7ad5a50a3676befb32547bd0fa0c266e8cc6d0b72ea9a12d7fc7e99ef63ef36"} Jul 07 22:24:15.927623 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:15.927575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bdf95f944-r4vgw" event={"ID":"2f65d232-63bb-4a09-bff8-fc151eb24fba","Type":"ContainerStarted","Data":"41e3acd9075c86bf4491674d5e524d6439dfa2fd7905ac5d5a6e2574c5273563"} Jul 07 22:24:16.936801 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.936338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-265jt" event={"ID":"11cf1efb-9f34-49bf-a6fb-cd38f4fd1289","Type":"ContainerStarted","Data":"b421084f3802940db20b2dd7af888fbfd8f6be25a67f209f6c83afabc96c0449"} Jul 07 22:24:16.937285 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.936924 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:16.938632 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.938566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bdf95f944-r4vgw" event={"ID":"2f65d232-63bb-4a09-bff8-fc151eb24fba","Type":"ContainerStarted","Data":"013fe60eefe964a0e6e6b7b13292032819f8bb942d612f4b38108160f9c3d770"} Jul 07 22:24:16.938774 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.938701 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:16.940471 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.940448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" event={"ID":"151482dd-1f8e-403f-ab88-35070642257c","Type":"ContainerStarted","Data":"9ee072d5c45bc660e1aee34047f9f8574e464fcb1a7cb894ffdb03f5cc3ccb58"} Jul 07 22:24:16.940606 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.940490 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:16.952066 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.952027 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-265jt" podStartSLOduration=1.6865219759999999 podStartE2EDuration="2.95201332s" totalImagesPullingTime="1.265491344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:24:16.951315392 +0000 UTC m=+555.410019053" watchObservedRunningTime="2026-07-07 22:24:16.95201332 +0000 UTC m=+555.410716974" Jul 07 22:24:16.970127 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.970087 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7bdf95f944-r4vgw" podStartSLOduration=2.271281354 podStartE2EDuration="3.970073656s" totalImagesPullingTime="1.698792302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:24:16.968126224 +0000 UTC m=+555.426829882" watchObservedRunningTime="2026-07-07 22:24:16.970073656 +0000 UTC m=+555.428777312" Jul 07 22:24:16.983261 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:16.983220 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" podStartSLOduration=1.670849321 podStartE2EDuration="2.983205794s" totalImagesPullingTime="1.312356473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:24:16.981363575 +0000 UTC m=+555.440067230" watchObservedRunningTime="2026-07-07 22:24:16.983205794 +0000 UTC m=+555.441909462" Jul 07 22:24:22.952987 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:22.952957 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7bdf95f944-r4vgw" Jul 07 22:24:24.314400 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:24.314367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:25.746723 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:25.746690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:27.949216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:27.949171 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-k25kq" Jul 07 22:24:28.954335 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:28.954300 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-265jt" Jul 07 22:24:35.367759 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.367729 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s"] Jul 07 22:24:35.371150 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.371132 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.373752 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.373731 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nwrnv\"" Jul 07 22:24:35.373873 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.373731 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 22:24:35.373873 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.373784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 07 22:24:35.373873 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.373815 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 22:24:35.388273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.387945 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s"] Jul 07 22:24:35.389529 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.389499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:35.433899 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.433874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.434074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.433906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.434074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.433932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.434074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.434041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce339944-f2c9-417c-baec-7d306f707bf1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.434074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.434064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r24vq\" (UniqueName: \"kubernetes.io/projected/ce339944-f2c9-417c-baec-7d306f707bf1-kube-api-access-r24vq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.434263 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.434241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535318 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535502 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535502 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535502 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535502 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce339944-f2c9-417c-baec-7d306f707bf1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535502 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r24vq\" (UniqueName: \"kubernetes.io/projected/ce339944-f2c9-417c-baec-7d306f707bf1-kube-api-access-r24vq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535829 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535801 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.535892 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.535883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.537778 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.537755 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce339944-f2c9-417c-baec-7d306f707bf1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.537963 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.537945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce339944-f2c9-417c-baec-7d306f707bf1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.542837 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.542820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r24vq\" (UniqueName: \"kubernetes.io/projected/ce339944-f2c9-417c-baec-7d306f707bf1-kube-api-access-r24vq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s\" (UID: \"ce339944-f2c9-417c-baec-7d306f707bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.682434 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.682345 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:35.820644 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:35.820589 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s"] Jul 07 22:24:35.821983 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:24:35.821959 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce339944_f2c9_417c_baec_7d306f707bf1.slice/crio-a6e74aae8f0b41bfacd0710c5622c0cfa8cafb60f9a66551d96ddccff034487e WatchSource:0}: Error finding container a6e74aae8f0b41bfacd0710c5622c0cfa8cafb60f9a66551d96ddccff034487e: Status 404 returned error can't find the container with id a6e74aae8f0b41bfacd0710c5622c0cfa8cafb60f9a66551d96ddccff034487e Jul 07 22:24:36.055469 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:36.055430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" event={"ID":"ce339944-f2c9-417c-baec-7d306f707bf1","Type":"ContainerStarted","Data":"a6e74aae8f0b41bfacd0710c5622c0cfa8cafb60f9a66551d96ddccff034487e"} Jul 07 22:24:37.062839 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:37.062808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" event={"ID":"ce339944-f2c9-417c-baec-7d306f707bf1","Type":"ContainerStarted","Data":"a1e4b8252ce9de40b410550fe220bd46f7fc3c599ea0908d969cd5601b011569"} Jul 07 22:24:37.081187 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:37.081143 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" podStartSLOduration=1.0689962689999999 podStartE2EDuration="2.081128243s" totalImagesPullingTime="1.012131974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:24:37.078366798 +0000 UTC m=+575.537070476" watchObservedRunningTime="2026-07-07 22:24:37.081128243 +0000 UTC m=+575.539831898" Jul 07 22:24:45.683510 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:45.683460 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:45.683947 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:45.683575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:45.696131 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:45.696104 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:46.122286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:46.122260 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s" Jul 07 22:24:56.112451 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:56.112410 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:24:59.980749 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:24:59.980712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:25:19.063370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.063336 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx"] Jul 07 22:25:19.067157 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.067140 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.069544 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.069522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 22:25:19.075176 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.075152 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx"] Jul 07 22:25:19.091907 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.091881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:25:19.111183 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.111153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qv8x\" (UniqueName: \"kubernetes.io/projected/aafe4f29-bfa8-4a0c-9383-f19275982b65-kube-api-access-8qv8x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.111314 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.111203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.111314 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.111246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.111314 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.111284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.111424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.111339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafe4f29-bfa8-4a0c-9383-f19275982b65-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.111424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.111383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.212804 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.212767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.212804 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.212803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213049 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.212824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213049 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.212879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafe4f29-bfa8-4a0c-9383-f19275982b65-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213049 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.212927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213049 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.212977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qv8x\" (UniqueName: \"kubernetes.io/projected/aafe4f29-bfa8-4a0c-9383-f19275982b65-kube-api-access-8qv8x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213265 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.213153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213265 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.213206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.213265 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.213241 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.215184 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.215152 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aafe4f29-bfa8-4a0c-9383-f19275982b65-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.215421 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.215406 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafe4f29-bfa8-4a0c-9383-f19275982b65-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.220426 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.220402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qv8x\" (UniqueName: \"kubernetes.io/projected/aafe4f29-bfa8-4a0c-9383-f19275982b65-kube-api-access-8qv8x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx\" (UID: \"aafe4f29-bfa8-4a0c-9383-f19275982b65\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.380028 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.379929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:19.511418 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.511387 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx"] Jul 07 22:25:19.512962 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:25:19.512937 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafe4f29_bfa8_4a0c_9383_f19275982b65.slice/crio-fe3512277616254cefafe7520fe157eb837ef33c73aa8763f747538d8935c1a7 WatchSource:0}: Error finding container fe3512277616254cefafe7520fe157eb837ef33c73aa8763f747538d8935c1a7: Status 404 returned error can't find the container with id fe3512277616254cefafe7520fe157eb837ef33c73aa8763f747538d8935c1a7 Jul 07 22:25:19.514369 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:19.514349 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 22:25:20.294994 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:20.294953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" event={"ID":"aafe4f29-bfa8-4a0c-9383-f19275982b65","Type":"ContainerStarted","Data":"b6eb0ea0bde368e2369dc74cf078c2358d34e09a755915662ef3eaa368c60229"} Jul 07 22:25:20.295373 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:20.295050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" event={"ID":"aafe4f29-bfa8-4a0c-9383-f19275982b65","Type":"ContainerStarted","Data":"fe3512277616254cefafe7520fe157eb837ef33c73aa8763f747538d8935c1a7"} Jul 07 22:25:20.314120 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:20.314064 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" podStartSLOduration=1.125730702 podStartE2EDuration="1.314049742s" totalImagesPullingTime="188.31904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:25:20.311113518 +0000 UTC m=+618.769817173" watchObservedRunningTime="2026-07-07 22:25:20.314049742 +0000 UTC m=+618.772753397" Jul 07 22:25:29.380314 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:29.380244 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:29.380700 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:29.380318 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:29.393161 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:29.393137 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:30.364069 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:30.364040 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx" Jul 07 22:25:32.501156 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:32.501104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:25:38.901827 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:25:38.901773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:26:53.118371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:26:53.118283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:26:53.222964 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:26:53.222928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:26:54.210483 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:26:54.210448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:26:54.317348 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:26:54.317298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:04.240657 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.240605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:04.339078 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.339047 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765c58f989-nxgtr"] Jul 07 22:28:04.339384 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.339353 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-765c58f989-nxgtr" podUID="5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" containerName="manager" containerID="cri-o://7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005" gracePeriod=30 Jul 07 22:28:04.593136 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.593108 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:28:04.671033 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.671006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf252\" (UniqueName: \"kubernetes.io/projected/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-kube-api-access-cf252\") pod \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " Jul 07 22:28:04.671202 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.671054 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-webhook-cert\") pod \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\" (UID: \"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d\") " Jul 07 22:28:04.672982 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.672949 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" (UID: "5fe94207-9ed9-47e7-9d82-ca4fb232fd5d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:28:04.673099 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.673060 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-kube-api-access-cf252" (OuterVolumeSpecName: "kube-api-access-cf252") pod "5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" (UID: "5fe94207-9ed9-47e7-9d82-ca4fb232fd5d"). InnerVolumeSpecName "kube-api-access-cf252". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:28:04.772371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.772305 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf252\" (UniqueName: \"kubernetes.io/projected/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-kube-api-access-cf252\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:04.772371 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:04.772327 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d-webhook-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:05.197390 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.197356 2581 generic.go:356] "Generic (PLEG): container finished" podID="5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" containerID="7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005" exitCode=0 Jul 07 22:28:05.197539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.197404 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c58f989-nxgtr" Jul 07 22:28:05.197539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.197407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c58f989-nxgtr" event={"ID":"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d","Type":"ContainerDied","Data":"7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005"} Jul 07 22:28:05.197539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.197469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c58f989-nxgtr" event={"ID":"5fe94207-9ed9-47e7-9d82-ca4fb232fd5d","Type":"ContainerDied","Data":"d8781612edbd8927cc14e6ef8be4f29da18ad836ae45aeb21995c62577f3d2b5"} Jul 07 22:28:05.197539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.197494 2581 scope.go:117] "RemoveContainer" containerID="7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005" Jul 07 22:28:05.206800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.206778 2581 scope.go:117] "RemoveContainer" containerID="7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005" Jul 07 22:28:05.207045 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:28:05.207027 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005\": container with ID starting with 7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005 not found: ID does not exist" containerID="7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005" Jul 07 22:28:05.207090 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.207053 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005"} err="failed to get container status \"7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005\": rpc error: code = NotFound desc = could not find container \"7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005\": container with ID starting with 7c20ec61d8acccc5a7766979db7adaff8b41f6ed3bc69b30cf98185860150005 not found: ID does not exist" Jul 07 22:28:05.222679 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.222650 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765c58f989-nxgtr"] Jul 07 22:28:05.224491 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.224470 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-765c58f989-nxgtr"] Jul 07 22:28:05.847245 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.847205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:05.956924 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.956841 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765c58f989-njlqp"] Jul 07 22:28:05.957410 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.957387 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" containerName="manager" Jul 07 22:28:05.957410 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.957410 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" containerName="manager" Jul 07 22:28:05.957551 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.957497 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" containerName="manager" Jul 07 22:28:05.961785 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.961771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:05.964260 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.964242 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 22:28:05.965215 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.965197 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gzwhb\"" Jul 07 22:28:05.965285 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.965203 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 22:28:05.969870 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:05.969847 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765c58f989-njlqp"] Jul 07 22:28:06.082493 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.082455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cttp9\" (UniqueName: \"kubernetes.io/projected/109739f4-c30c-47c2-a7b2-6941d6699f25-kube-api-access-cttp9\") pod \"maas-controller-765c58f989-njlqp\" (UID: \"109739f4-c30c-47c2-a7b2-6941d6699f25\") " pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.082701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.082532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/109739f4-c30c-47c2-a7b2-6941d6699f25-webhook-cert\") pod \"maas-controller-765c58f989-njlqp\" (UID: \"109739f4-c30c-47c2-a7b2-6941d6699f25\") " pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.183355 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.183266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/109739f4-c30c-47c2-a7b2-6941d6699f25-webhook-cert\") pod \"maas-controller-765c58f989-njlqp\" (UID: \"109739f4-c30c-47c2-a7b2-6941d6699f25\") " pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.183355 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.183328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cttp9\" (UniqueName: \"kubernetes.io/projected/109739f4-c30c-47c2-a7b2-6941d6699f25-kube-api-access-cttp9\") pod \"maas-controller-765c58f989-njlqp\" (UID: \"109739f4-c30c-47c2-a7b2-6941d6699f25\") " pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.185656 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.185636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/109739f4-c30c-47c2-a7b2-6941d6699f25-webhook-cert\") pod \"maas-controller-765c58f989-njlqp\" (UID: \"109739f4-c30c-47c2-a7b2-6941d6699f25\") " pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.191835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.191811 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cttp9\" (UniqueName: \"kubernetes.io/projected/109739f4-c30c-47c2-a7b2-6941d6699f25-kube-api-access-cttp9\") pod \"maas-controller-765c58f989-njlqp\" (UID: \"109739f4-c30c-47c2-a7b2-6941d6699f25\") " pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.274144 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.274108 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:06.410033 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:06.410001 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765c58f989-njlqp"] Jul 07 22:28:06.411258 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:28:06.411234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109739f4_c30c_47c2_a7b2_6941d6699f25.slice/crio-042b90ee450f2997adc3d8dae33507f49b9436118a97557a8ddbc82b58aea2cc WatchSource:0}: Error finding container 042b90ee450f2997adc3d8dae33507f49b9436118a97557a8ddbc82b58aea2cc: Status 404 returned error can't find the container with id 042b90ee450f2997adc3d8dae33507f49b9436118a97557a8ddbc82b58aea2cc Jul 07 22:28:07.145768 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:07.145684 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe94207-9ed9-47e7-9d82-ca4fb232fd5d" path="/var/lib/kubelet/pods/5fe94207-9ed9-47e7-9d82-ca4fb232fd5d/volumes" Jul 07 22:28:07.212047 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:07.212015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c58f989-njlqp" event={"ID":"109739f4-c30c-47c2-a7b2-6941d6699f25","Type":"ContainerStarted","Data":"37b7bb7299945cea510fcdbfab0ce6d8f595c225ac201e732b2a65e457b316b1"} Jul 07 22:28:07.212206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:07.212077 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:07.212206 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:07.212100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c58f989-njlqp" event={"ID":"109739f4-c30c-47c2-a7b2-6941d6699f25","Type":"ContainerStarted","Data":"042b90ee450f2997adc3d8dae33507f49b9436118a97557a8ddbc82b58aea2cc"} Jul 07 22:28:07.228096 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:07.228049 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-765c58f989-njlqp" podStartSLOduration=1.770323684 podStartE2EDuration="2.228034529s" totalImagesPullingTime="457.710845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:28:07.226535225 +0000 UTC m=+785.685238887" watchObservedRunningTime="2026-07-07 22:28:07.228034529 +0000 UTC m=+785.686738183" Jul 07 22:28:12.864351 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:12.864311 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:18.222562 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:18.222531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765c58f989-njlqp" Jul 07 22:28:19.288050 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.288021 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66fbb56444-ftv8n"] Jul 07 22:28:19.292004 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.291985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.300747 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.300729 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fbb56444-ftv8n"] Jul 07 22:28:19.346541 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.346502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:19.407323 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-oauth-serving-cert\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.407474 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-serving-cert\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.407474 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-service-ca\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.407578 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-config\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.407578 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpsdw\" (UniqueName: \"kubernetes.io/projected/eb1da216-62d1-4db8-abd2-59f75f34a42b-kube-api-access-wpsdw\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.407578 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-oauth-config\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.407737 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.407650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-trusted-ca-bundle\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.479865 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.479843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:19.508286 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-serving-cert\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.508406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-service-ca\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.508406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-config\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.508406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpsdw\" (UniqueName: \"kubernetes.io/projected/eb1da216-62d1-4db8-abd2-59f75f34a42b-kube-api-access-wpsdw\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.508406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-oauth-config\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.508548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-trusted-ca-bundle\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.508548 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.508536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-oauth-serving-cert\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.509279 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.509258 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-config\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.509392 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.509341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-service-ca\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.509453 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.509411 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-trusted-ca-bundle\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.509453 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.509440 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb1da216-62d1-4db8-abd2-59f75f34a42b-oauth-serving-cert\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.510839 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.510822 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-serving-cert\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.510927 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.510865 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb1da216-62d1-4db8-abd2-59f75f34a42b-console-oauth-config\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.516268 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.516251 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpsdw\" (UniqueName: \"kubernetes.io/projected/eb1da216-62d1-4db8-abd2-59f75f34a42b-kube-api-access-wpsdw\") pod \"console-66fbb56444-ftv8n\" (UID: \"eb1da216-62d1-4db8-abd2-59f75f34a42b\") " pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.602556 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.602481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:19.737873 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:19.737850 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fbb56444-ftv8n"] Jul 07 22:28:19.739106 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:28:19.739079 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1da216_62d1_4db8_abd2_59f75f34a42b.slice/crio-ebeee44ad06fbaf2678e2d5afd75de400914629ba26f72aac267db90e761edfa WatchSource:0}: Error finding container ebeee44ad06fbaf2678e2d5afd75de400914629ba26f72aac267db90e761edfa: Status 404 returned error can't find the container with id ebeee44ad06fbaf2678e2d5afd75de400914629ba26f72aac267db90e761edfa Jul 07 22:28:20.084627 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:20.084585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:20.285520 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:20.285485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fbb56444-ftv8n" event={"ID":"eb1da216-62d1-4db8-abd2-59f75f34a42b","Type":"ContainerStarted","Data":"f07f450e17c1fd3ed9788e1ca30fc5aaf79b4952f6875c7cd17ed3f37f84c5df"} Jul 07 22:28:20.285715 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:20.285539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fbb56444-ftv8n" event={"ID":"eb1da216-62d1-4db8-abd2-59f75f34a42b","Type":"ContainerStarted","Data":"ebeee44ad06fbaf2678e2d5afd75de400914629ba26f72aac267db90e761edfa"} Jul 07 22:28:20.304828 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:20.304780 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66fbb56444-ftv8n" podStartSLOduration=1.304766983 podStartE2EDuration="1.304766983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:28:20.30259258 +0000 UTC m=+798.761296255" watchObservedRunningTime="2026-07-07 22:28:20.304766983 +0000 UTC m=+798.763470638" Jul 07 22:28:29.603440 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:29.603360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:29.603440 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:29.603420 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:29.608370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:29.608340 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:30.350698 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:30.350667 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66fbb56444-ftv8n" Jul 07 22:28:30.399370 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:30.399336 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755b8bc6f-gk5k4"] Jul 07 22:28:30.495195 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:30.495158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:30.595766 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:30.595724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:30.696775 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:30.696684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:44.219700 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:44.219628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:44.312515 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:44.312478 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:44.421361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:44.421322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:50.101437 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:50.101400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:50.153963 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:50.153935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:50.224551 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:50.224518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:50.322641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:50.322579 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:50.423841 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:50.423752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:55.421479 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.421444 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-755b8bc6f-gk5k4" podUID="dc9cc881-26c6-4e91-b3ba-013e06aa6b28" containerName="console" containerID="cri-o://0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936" gracePeriod=15 Jul 07 22:28:55.683299 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.683237 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:28:55.840744 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840712 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-service-ca\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.840942 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840789 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-oauth-serving-cert\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.840942 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840818 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-config\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.840942 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840848 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-trusted-ca-bundle\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.840942 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzzpn\" (UniqueName: \"kubernetes.io/projected/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-kube-api-access-qzzpn\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.841158 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840947 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-serving-cert\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.841158 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.840997 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-oauth-config\") pod \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\" (UID: \"dc9cc881-26c6-4e91-b3ba-013e06aa6b28\") " Jul 07 22:28:55.841158 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841135 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:28:55.841319 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841203 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-config" (OuterVolumeSpecName: "console-config") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:28:55.841319 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841287 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:28:55.841429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841356 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:28:55.841468 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841458 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-service-ca\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:55.841508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841471 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-oauth-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:55.841508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841481 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:55.841508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.841489 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-trusted-ca-bundle\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:55.843057 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.843037 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:28:55.843519 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.843493 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:28:55.843688 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.843517 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-kube-api-access-qzzpn" (OuterVolumeSpecName: "kube-api-access-qzzpn") pod "dc9cc881-26c6-4e91-b3ba-013e06aa6b28" (UID: "dc9cc881-26c6-4e91-b3ba-013e06aa6b28"). InnerVolumeSpecName "kube-api-access-qzzpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:28:55.942337 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.942265 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzzpn\" (UniqueName: \"kubernetes.io/projected/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-kube-api-access-qzzpn\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:55.942337 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.942291 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-serving-cert\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:55.942337 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:55.942300 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc9cc881-26c6-4e91-b3ba-013e06aa6b28-console-oauth-config\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:28:56.029887 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.029857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:56.096042 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.096012 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:28:56.495099 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.495066 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc9cc881-26c6-4e91-b3ba-013e06aa6b28" containerID="0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936" exitCode=0 Jul 07 22:28:56.495099 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.495105 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b8bc6f-gk5k4" Jul 07 22:28:56.495565 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.495151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b8bc6f-gk5k4" event={"ID":"dc9cc881-26c6-4e91-b3ba-013e06aa6b28","Type":"ContainerDied","Data":"0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936"} Jul 07 22:28:56.495565 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.495203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b8bc6f-gk5k4" event={"ID":"dc9cc881-26c6-4e91-b3ba-013e06aa6b28","Type":"ContainerDied","Data":"2bb13adfbd7fb198376d3c55fc7694c97daff0067d18f361bc6ece0c992b8233"} Jul 07 22:28:56.495565 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.495224 2581 scope.go:117] "RemoveContainer" containerID="0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936" Jul 07 22:28:56.505128 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.505113 2581 scope.go:117] "RemoveContainer" containerID="0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936" Jul 07 22:28:56.505375 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:28:56.505359 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936\": container with ID starting with 0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936 not found: ID does not exist" containerID="0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936" Jul 07 22:28:56.505424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.505384 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936"} err="failed to get container status \"0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936\": rpc error: code = NotFound desc = could not find container \"0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936\": container with ID starting with 0937d6d7a8a75b17642d823189f7c71a97ac2dea412f491133b4a0d93c225936 not found: ID does not exist" Jul 07 22:28:56.524325 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.524301 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755b8bc6f-gk5k4"] Jul 07 22:28:56.538412 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:56.538390 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755b8bc6f-gk5k4"] Jul 07 22:28:57.151372 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:28:57.151335 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9cc881-26c6-4e91-b3ba-013e06aa6b28" path="/var/lib/kubelet/pods/dc9cc881-26c6-4e91-b3ba-013e06aa6b28/volumes" Jul 07 22:30:08.362469 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:30:08.362436 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:30:21.708809 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:30:21.708770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:31:19.346941 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:31:19.346906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:33:38.930716 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:38.930676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:33:38.981174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:38.981135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:33:44.762460 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.762420 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp"] Jul 07 22:33:44.762905 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.762890 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9cc881-26c6-4e91-b3ba-013e06aa6b28" containerName="console" Jul 07 22:33:44.762950 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.762906 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9cc881-26c6-4e91-b3ba-013e06aa6b28" containerName="console" Jul 07 22:33:44.762997 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.762987 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9cc881-26c6-4e91-b3ba-013e06aa6b28" containerName="console" Jul 07 22:33:44.766229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.766213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:44.768728 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.768706 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xs4cq\"" Jul 07 22:33:44.781158 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.781129 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp"] Jul 07 22:33:44.833527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.833493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmngs\" (UniqueName: \"kubernetes.io/projected/5ca13e14-474a-4867-8f73-19eb3cd20e2a-kube-api-access-tmngs\") pod \"kuadrant-operator-controller-manager-86878c769f-xwsnp\" (UID: \"5ca13e14-474a-4867-8f73-19eb3cd20e2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:44.833527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.833540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ca13e14-474a-4867-8f73-19eb3cd20e2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xwsnp\" (UID: \"5ca13e14-474a-4867-8f73-19eb3cd20e2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:44.934430 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.934388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ca13e14-474a-4867-8f73-19eb3cd20e2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xwsnp\" (UID: \"5ca13e14-474a-4867-8f73-19eb3cd20e2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:44.934600 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.934485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmngs\" (UniqueName: \"kubernetes.io/projected/5ca13e14-474a-4867-8f73-19eb3cd20e2a-kube-api-access-tmngs\") pod \"kuadrant-operator-controller-manager-86878c769f-xwsnp\" (UID: \"5ca13e14-474a-4867-8f73-19eb3cd20e2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:44.934785 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.934765 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ca13e14-474a-4867-8f73-19eb3cd20e2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xwsnp\" (UID: \"5ca13e14-474a-4867-8f73-19eb3cd20e2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:44.943016 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:44.942993 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmngs\" (UniqueName: \"kubernetes.io/projected/5ca13e14-474a-4867-8f73-19eb3cd20e2a-kube-api-access-tmngs\") pod \"kuadrant-operator-controller-manager-86878c769f-xwsnp\" (UID: \"5ca13e14-474a-4867-8f73-19eb3cd20e2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:45.076949 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:45.076867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:45.240429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:45.240399 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp"] Jul 07 22:33:45.240804 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:33:45.240783 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca13e14_474a_4867_8f73_19eb3cd20e2a.slice/crio-62a235d44a5e74c104c446e98a17bba971adea677edc36ebbe720b36307d6f28 WatchSource:0}: Error finding container 62a235d44a5e74c104c446e98a17bba971adea677edc36ebbe720b36307d6f28: Status 404 returned error can't find the container with id 62a235d44a5e74c104c446e98a17bba971adea677edc36ebbe720b36307d6f28 Jul 07 22:33:46.080059 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:46.080025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" event={"ID":"5ca13e14-474a-4867-8f73-19eb3cd20e2a","Type":"ContainerStarted","Data":"20921f8a4318e8281c251948f90a2889393c4ee9c1417de4d17024536eb3aaaa"} Jul 07 22:33:46.080555 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:46.080079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" event={"ID":"5ca13e14-474a-4867-8f73-19eb3cd20e2a","Type":"ContainerStarted","Data":"62a235d44a5e74c104c446e98a17bba971adea677edc36ebbe720b36307d6f28"} Jul 07 22:33:46.080555 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:46.080129 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:33:46.102174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:46.102118 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" podStartSLOduration=2.102101874 podStartE2EDuration="2.102101874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:33:46.099439391 +0000 UTC m=+1124.558143038" watchObservedRunningTime="2026-07-07 22:33:46.102101874 +0000 UTC m=+1124.560805531" Jul 07 22:33:57.088386 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:33:57.088358 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwsnp" Jul 07 22:36:21.829539 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:36:21.829452 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:37:46.786944 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:37:46.786907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:38:49.913424 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:38:49.913390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:09.350361 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:09.350270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:32.490156 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:32.490110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:42.061880 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:42.061845 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:50.331736 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:50.331701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:55.396347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:55.396313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:58.103287 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:58.103253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:58.206595 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:58.206557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:58.589185 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:58.589153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:39:59.141946 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:39:59.141910 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:04.321861 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:04.321826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:04.426701 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:04.426672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:04.545957 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:04.545926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:04.619641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:04.619534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:05.703382 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.703350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:05.771948 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.771921 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr"] Jul 07 22:40:05.774825 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.774801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:05.775867 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.775849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:05.778142 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.778119 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-638b90a2-serving-cert\"" Jul 07 22:40:05.785477 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.785454 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr"] Jul 07 22:40:05.842079 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.842036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:05.912952 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.912921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28xg\" (UniqueName: \"kubernetes.io/projected/4003633f-e460-40d2-8374-368a66b5acc3-kube-api-access-s28xg\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:05.913137 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.912968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003633f-e460-40d2-8374-368a66b5acc3-openshift-service-ca\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:05.913137 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:05.913114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.014059 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.014027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28xg\" (UniqueName: \"kubernetes.io/projected/4003633f-e460-40d2-8374-368a66b5acc3-kube-api-access-s28xg\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.014243 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.014081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003633f-e460-40d2-8374-368a66b5acc3-openshift-service-ca\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.014243 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.014134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.014243 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:40:06.014223 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-638b90a2-serving-cert: secret "maas-api-e2e-ait-638b90a2-serving-cert" not found Jul 07 22:40:06.014458 ip-10-0-142-33 kubenswrapper[2581]: E0707 22:40:06.014273 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls podName:4003633f-e460-40d2-8374-368a66b5acc3 nodeName:}" failed. No retries permitted until 2026-07-07 22:40:06.514258073 +0000 UTC m=+1504.972961706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls") pod "maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" (UID: "4003633f-e460-40d2-8374-368a66b5acc3") : secret "maas-api-e2e-ait-638b90a2-serving-cert" not found Jul 07 22:40:06.014877 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.014849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003633f-e460-40d2-8374-368a66b5acc3-openshift-service-ca\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.052008 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.051983 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28xg\" (UniqueName: \"kubernetes.io/projected/4003633f-e460-40d2-8374-368a66b5acc3-kube-api-access-s28xg\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.116322 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.116286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:06.325720 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.325601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:06.426059 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.425996 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:06.520167 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.520133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.522558 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.522521 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls\") pod \"maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.689569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.689471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:06.836116 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.836088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr"] Jul 07 22:40:06.839049 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:40:06.839019 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4003633f_e460_40d2_8374_368a66b5acc3.slice/crio-f1a21a79535820465deea38bce7564c0e0c3e9da02b8616fe1be5653b816735a WatchSource:0}: Error finding container f1a21a79535820465deea38bce7564c0e0c3e9da02b8616fe1be5653b816735a: Status 404 returned error can't find the container with id f1a21a79535820465deea38bce7564c0e0c3e9da02b8616fe1be5653b816735a Jul 07 22:40:06.840292 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:06.840270 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 22:40:07.228355 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:07.228320 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" event={"ID":"4003633f-e460-40d2-8374-368a66b5acc3","Type":"ContainerStarted","Data":"f1a21a79535820465deea38bce7564c0e0c3e9da02b8616fe1be5653b816735a"} Jul 07 22:40:08.102396 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:08.102365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:08.235454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:08.235416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" event={"ID":"4003633f-e460-40d2-8374-368a66b5acc3","Type":"ContainerStarted","Data":"655bf31287585cac6a7c231d667be277a289fd804feb34987ca9ffaf9296d8fd"} Jul 07 22:40:08.235641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:08.235506 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:08.253529 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:08.253482 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" podStartSLOduration=2.666816587 podStartE2EDuration="3.253465849s" totalImagesPullingTime="586.649262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:40:08.252074066 +0000 UTC m=+1506.710777778" watchObservedRunningTime="2026-07-07 22:40:08.253465849 +0000 UTC m=+1506.712169530" Jul 07 22:40:10.320798 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:10.320765 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:10.730304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:10.730230 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:10.940812 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:10.940772 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:11.040260 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.040233 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:11.125129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.125096 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr"] Jul 07 22:40:11.125710 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.125569 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" podUID="4003633f-e460-40d2-8374-368a66b5acc3" containerName="maas-api" containerID="cri-o://655bf31287585cac6a7c231d667be277a289fd804feb34987ca9ffaf9296d8fd" gracePeriod=30 Jul 07 22:40:11.152201 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.152165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:11.254504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.254474 2581 generic.go:356] "Generic (PLEG): container finished" podID="4003633f-e460-40d2-8374-368a66b5acc3" containerID="655bf31287585cac6a7c231d667be277a289fd804feb34987ca9ffaf9296d8fd" exitCode=0 Jul 07 22:40:11.254673 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.254551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" event={"ID":"4003633f-e460-40d2-8374-368a66b5acc3","Type":"ContainerDied","Data":"655bf31287585cac6a7c231d667be277a289fd804feb34987ca9ffaf9296d8fd"} Jul 07 22:40:11.379557 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.379536 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:11.459833 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.459806 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls\") pod \"4003633f-e460-40d2-8374-368a66b5acc3\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " Jul 07 22:40:11.459985 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.459850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003633f-e460-40d2-8374-368a66b5acc3-openshift-service-ca\") pod \"4003633f-e460-40d2-8374-368a66b5acc3\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " Jul 07 22:40:11.459985 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.459894 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s28xg\" (UniqueName: \"kubernetes.io/projected/4003633f-e460-40d2-8374-368a66b5acc3-kube-api-access-s28xg\") pod \"4003633f-e460-40d2-8374-368a66b5acc3\" (UID: \"4003633f-e460-40d2-8374-368a66b5acc3\") " Jul 07 22:40:11.460269 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.460232 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4003633f-e460-40d2-8374-368a66b5acc3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4003633f-e460-40d2-8374-368a66b5acc3" (UID: "4003633f-e460-40d2-8374-368a66b5acc3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 22:40:11.461947 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.461925 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4003633f-e460-40d2-8374-368a66b5acc3" (UID: "4003633f-e460-40d2-8374-368a66b5acc3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 22:40:11.462046 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.461966 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4003633f-e460-40d2-8374-368a66b5acc3-kube-api-access-s28xg" (OuterVolumeSpecName: "kube-api-access-s28xg") pod "4003633f-e460-40d2-8374-368a66b5acc3" (UID: "4003633f-e460-40d2-8374-368a66b5acc3"). InnerVolumeSpecName "kube-api-access-s28xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 22:40:11.560905 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.560821 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003633f-e460-40d2-8374-368a66b5acc3-maas-api-tls\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:40:11.560905 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.560849 2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003633f-e460-40d2-8374-368a66b5acc3-openshift-service-ca\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:40:11.560905 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:11.560859 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s28xg\" (UniqueName: \"kubernetes.io/projected/4003633f-e460-40d2-8374-368a66b5acc3-kube-api-access-s28xg\") on node \"ip-10-0-142-33.ec2.internal\" DevicePath \"\"" Jul 07 22:40:12.261881 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:12.261850 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" Jul 07 22:40:12.261881 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:12.261865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr" event={"ID":"4003633f-e460-40d2-8374-368a66b5acc3","Type":"ContainerDied","Data":"f1a21a79535820465deea38bce7564c0e0c3e9da02b8616fe1be5653b816735a"} Jul 07 22:40:12.262135 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:12.261920 2581 scope.go:117] "RemoveContainer" containerID="655bf31287585cac6a7c231d667be277a289fd804feb34987ca9ffaf9296d8fd" Jul 07 22:40:12.286292 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:12.286268 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr"] Jul 07 22:40:12.291390 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:12.291368 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-638b90a2-9bcb89dc6-nbkpr"] Jul 07 22:40:13.145526 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:13.145492 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4003633f-e460-40d2-8374-368a66b5acc3" path="/var/lib/kubelet/pods/4003633f-e460-40d2-8374-368a66b5acc3/volumes" Jul 07 22:40:14.079463 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:14.079432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:16.658674 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:16.658631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:16.715170 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:16.715143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:16.865306 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:16.865274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:16.965104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:16.965022 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:17.948653 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:17.948604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:18.027724 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:18.027695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:18.091571 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:18.091539 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:18.231281 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:18.231203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:18.483020 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:18.482938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:18.583916 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:18.583886 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:20.341233 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:20.341200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:23.022595 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:23.022556 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:23.305476 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:23.305371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:29.087501 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:29.087463 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:29.178543 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:29.178507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:31.618518 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:31.618493 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:34.767119 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:34.767088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:34.867514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:34.867484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:34.973775 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:34.973742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:35.074665 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:35.074570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:36.152152 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:36.152117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:36.234217 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:36.234188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:36.296711 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:36.296673 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:36.585514 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:36.585485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:36.715809 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:36.715773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:36.820861 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:36.820830 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:38.135549 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:38.135521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:40.502546 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:40.502503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:40.685338 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:40.685303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:40.842029 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:40.841907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:40.937832 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:40.937785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:42.398499 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:42.398472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:46.715012 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:46.714977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:46.815022 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:46.814981 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:47.175048 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:47.175011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:47.271200 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:47.271158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:47.370624 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:47.370589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:48.704518 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:48.704476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:54.498936 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:54.498895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:54.558669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:54.558635 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:54.641077 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:54.641037 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:54.740016 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:54.739984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:54.841951 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:54.841862 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:40:55.157393 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:40:55.157302 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:21.100295 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:21.100252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:26.815216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:26.815178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:28.079633 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:28.079576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:42.843095 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:42.843055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:48.535480 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:48.535449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:48.638770 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:48.638736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:48.735412 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:48.735370 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:41:59.231391 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:41:59.231291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:00.044910 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:00.044871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:05.651404 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:05.651360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:05.757273 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:05.757242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:05.853039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:05.853004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:05.952795 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:05.952700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:06.661340 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:06.661302 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:06.760719 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:06.760652 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:06.859754 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:06.859724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:08.439237 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:08.439206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:14.375677 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:14.375649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:14.477000 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:14.476968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:15.031703 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:15.031671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:20.851350 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:20.851313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:20.914315 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:20.914282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:21.082267 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:21.082233 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:21.383374 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:21.383343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:21.549516 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:21.549481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:24.044375 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:24.044346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:24.133122 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:24.133093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:24.196110 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:24.196077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:24.296927 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:24.296840 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:24.580769 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:24.580683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:24.686004 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:24.685971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:28.540554 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:28.540514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:29.175271 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:29.175237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:29.278352 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:29.278311 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:29.616591 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:29.616560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:35.401537 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:35.401482 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:35.462920 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:35.462890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:35.806213 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:35.806181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:36.128100 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:36.127988 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:36.233076 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:36.233045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.108215 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.108182 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.208314 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.208286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.355093 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.355063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.567907 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.567868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.682791 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.682656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.781544 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.781511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:42.897935 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:42.897847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:48.658222 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:48.658185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:48.752048 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:48.752015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:48.843810 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:48.843770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:49.008685 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:49.008652 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:54.731530 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:54.731496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:42:54.832504 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:42:54.832469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:01.469677 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:01.469645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:01.768208 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:01.768176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:01.863198 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:01.863148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:04.188516 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:04.188480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:04.287931 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:04.287898 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:04.389867 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:04.389820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:04.698056 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:04.698018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:04.882077 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:04.882047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:04.983149 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:04.983065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:08.690686 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:08.690654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:15.997720 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:15.997684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:27.139971 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:27.139873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:27.238347 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:27.238309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:41.050226 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:41.050167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:41.592567 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:41.592522 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:41.693167 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:41.693132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:41.840431 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:41.840401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:47.100055 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:47.100021 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:43:52.175270 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:43:52.175238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:28.380084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:28.380052 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:29.033346 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:29.033313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:34.504482 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:34.504449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:34.605576 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:34.605544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:34.737035 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:34.737006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:34.956197 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:34.956097 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:35.988834 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:35.988799 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:36.089103 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:36.089065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:36.188446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:36.188414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:36.944062 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:36.944030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:37.033978 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:37.033942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:37.134407 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:37.134373 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:38.467006 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:38.466979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:44.391375 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:44.391337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:44.449773 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:44.449746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:45.041257 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:45.041223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:50.747922 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:50.747887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:50.856975 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:50.856947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:44:50.949469 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:44:50.949428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:01.440013 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:01.439979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:01.776743 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:01.776710 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:22.720158 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:22.720125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:28.541659 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:28.541588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:28.604418 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:28.604385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:28.891341 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:28.891264 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:29.219128 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:29.219029 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:29.434081 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:29.434051 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:31.885496 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:31.885461 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:31.954968 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:31.954933 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:32.022003 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:32.021972 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:32.433135 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:32.433105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:32.545390 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:32.545362 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:32.647546 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:32.647515 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:36.376727 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:36.376699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:36.703224 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:36.703138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:37.006406 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:37.006369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:37.590110 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:37.590076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:39.929656 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:39.929601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:40.007456 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:40.007424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:40.080084 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:40.080048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:40.295748 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:40.295716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:40.466569 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:40.466524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:40.573719 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:40.573634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:44.431924 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:44.431872 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:53.216431 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:53.216391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:53.319549 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:53.319519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:45:53.504051 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:45:53.504014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:46:01.142034 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:46:01.142002 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:46:01.242467 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:46:01.242429 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:46:08.005007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:46:08.004975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:46:31.576104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:46:31.576068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:46:37.663051 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:46:37.663016 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:46:59.579990 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:46:59.579953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:00.577623 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:00.577578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:00.724578 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:00.724540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:01.131650 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:01.131571 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:01.231534 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:01.231504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:01.376520 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:01.376491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:06.224709 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:06.224676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:18.406593 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:18.406559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:27.404120 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:27.404088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:42.816659 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:42.816627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:43.115948 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:43.115867 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:43.332508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:43.332480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:43.503587 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:43.503562 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:44.018346 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:44.018320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:44.119266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:44.119232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:44.219231 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:44.219200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:44.319676 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:44.319590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:49.904952 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:49.904914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:49.962009 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:49.961983 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:50.272226 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:50.272196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:50.667596 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:50.667506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:51.077472 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:51.077437 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:51.432587 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:51.432507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:52.173496 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:52.173469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:54.616039 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:54.615958 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:54.690585 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:54.690534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:54.755567 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:54.755531 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:55.080477 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:55.080428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:55.186007 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:55.185977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:55.286466 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:55.286435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:59.110675 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:59.110633 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:59.586601 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:59.586566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:47:59.965313 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:47:59.965219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:00.478368 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:00.478334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:02.774721 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:02.774691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:02.868869 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:02.868836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:03.029724 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:03.029629 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:03.271434 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:03.271406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:03.373163 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:03.373064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:07.234546 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:07.234513 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:15.338925 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:15.338880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:15.729304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:15.729225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:15.846917 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:15.846887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:15.946709 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:15.946675 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:16.087332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:16.087300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:21.385151 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:21.385119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:21.485768 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:21.485734 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:21.652508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:21.652433 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:21.869925 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:21.869891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:22.031413 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:22.031381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:22.431874 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:22.431785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:22.532281 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:22.532244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:22.749584 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:22.749549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:27.786601 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:27.786562 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:27.857413 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:27.857374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:28.480325 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:28.480279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:28.549519 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:28.549485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:28.742029 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:28.741970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:28.962855 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:28.962819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:29.276959 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:29.276927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:29.575820 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:29.575696 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:29.816606 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:29.816573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:32.775429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:32.775378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:32.908865 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:32.908834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:33.021788 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:33.021750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:33.112972 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:33.112885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:33.597954 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:33.597915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:33.696335 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:33.696294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:37.245508 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:37.245476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:37.583576 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:37.583500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:37.887364 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:37.887282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:38.036427 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:38.036393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:40.883961 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:40.883924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:40.984376 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:40.984343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:41.119936 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:41.119899 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:41.456871 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:41.456839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:41.554129 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:41.554090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:41.654466 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:41.654439 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:45.397401 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:45.397369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:47.508749 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:47.508721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:55.260973 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:55.260934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:48:55.359841 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:48:55.359806 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:49:02.194138 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:49:02.194095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:49:02.295074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:49:02.295040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:49:22.280097 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:49:22.280066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:50:57.208792 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:50:57.208705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:51:13.551114 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:51:13.551082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:51:14.428832 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:51:14.428805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:51:30.093210 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:51:30.093171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:51:54.197920 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:51:54.197891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:52:35.377886 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:52:35.377853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:52:36.287431 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:52:36.287398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:52:39.211872 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:52:39.211843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:00.459119 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:00.459069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:08.963821 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:08.963781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:28.470535 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:28.470497 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:28.571330 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:28.571299 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:39.808327 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:39.808295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:40.811333 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:40.811289 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:42.004784 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:42.004750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:42.391338 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:42.391254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:42.491162 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:42.491126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:42.599329 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:42.599297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:42.746744 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:42.746712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:53:47.468030 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:53:47.467985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:02.606598 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:02.606521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:02.866276 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:02.866178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:02.968580 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:02.968546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:24.553566 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:24.553525 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:24.837216 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:24.837127 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:25.071855 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:25.071818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:25.232929 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:25.232845 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:25.510338 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:25.510313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:25.636070 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:25.636015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:31.675306 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:31.675231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:31.737297 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:31.737261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:31.929014 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:31.928936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:32.152380 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:32.152345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:37.052009 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:37.051980 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b4b8w_b063713b-68a4-49bf-ad39-cf48d8ea7aa4/manager/0.log" Jul 07 22:54:37.167885 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:37.167850 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zk48f_11c8bb22-d6b7-4eea-a144-95b279481f4a/manager/0.log" Jul 07 22:54:37.290444 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:37.290414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bdf95f944-r4vgw_2f65d232-63bb-4a09-bff8-fc151eb24fba/maas-api/0.log" Jul 07 22:54:37.638094 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:37.638068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-765c58f989-njlqp_109739f4-c30c-47c2-a7b2-6941d6699f25/manager/0.log" Jul 07 22:54:37.866637 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:37.866592 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4dknx_33c08d12-ed40-4aaa-b47f-bb24ebba3ff7/manager/0.log" Jul 07 22:54:38.093669 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:38.093638 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb_b40c66af-6f09-462b-b758-07491e8d8e65/copy-manifests/0.log" Jul 07 22:54:38.100074 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:38.100050 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb_b40c66af-6f09-462b-b758-07491e8d8e65/manager/0.log" Jul 07 22:54:38.328740 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:38.328712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cnj85_106f0e80-98d2-4592-aa5a-c0baa7d6b909/postgres/0.log" Jul 07 22:54:39.122486 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.122454 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f_e71f36f8-e9d7-4481-a18c-30d696a0860d/util/0.log" Jul 07 22:54:39.128293 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.128269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f_e71f36f8-e9d7-4481-a18c-30d696a0860d/pull/0.log" Jul 07 22:54:39.134174 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.134154 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f_e71f36f8-e9d7-4481-a18c-30d696a0860d/extract/0.log" Jul 07 22:54:39.244930 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.244905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd_09fb116f-fc1f-45e8-ad0c-47875fa2a6cd/extract/0.log" Jul 07 22:54:39.250698 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.250679 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd_09fb116f-fc1f-45e8-ad0c-47875fa2a6cd/util/0.log" Jul 07 22:54:39.256716 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.256698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd_09fb116f-fc1f-45e8-ad0c-47875fa2a6cd/pull/0.log" Jul 07 22:54:39.370563 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.370535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr_7ace4843-1901-4efc-8ad6-5733cb65a0ce/util/0.log" Jul 07 22:54:39.376316 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.376254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr_7ace4843-1901-4efc-8ad6-5733cb65a0ce/pull/0.log" Jul 07 22:54:39.382005 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.381989 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr_7ace4843-1901-4efc-8ad6-5733cb65a0ce/extract/0.log" Jul 07 22:54:39.490527 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.490497 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq_bb1d7a83-ed51-4fd5-ae4c-05d331d72376/extract/0.log" Jul 07 22:54:39.496601 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.496575 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq_bb1d7a83-ed51-4fd5-ae4c-05d331d72376/util/0.log" Jul 07 22:54:39.502646 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.502606 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq_bb1d7a83-ed51-4fd5-ae4c-05d331d72376/pull/0.log" Jul 07 22:54:39.852145 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:39.852108 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bdzv8_49960870-18b9-407c-a498-540ddcee87c8/manager/0.log" Jul 07 22:54:40.082357 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:40.082313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4t69r_ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05/registry-server/0.log" Jul 07 22:54:40.196925 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:40.196844 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xwsnp_5ca13e14-474a-4867-8f73-19eb3cd20e2a/manager/0.log" Jul 07 22:54:40.421816 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:40.421780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9jtzh_5b0c763e-b58e-4b12-a689-abe66e5d8e61/manager/0.log" Jul 07 22:54:40.892542 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:40.892513 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-545d6_3d9c656d-4160-4df7-8fdf-b6967ad2b2b7/discovery/0.log" Jul 07 22:54:41.000655 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:41.000603 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776659d659-h6thb_86dab0ae-3671-49c1-a348-a4889660b724/kube-auth-proxy/0.log" Jul 07 22:54:41.353224 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:41.353191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k25kq_151482dd-1f8e-403f-ab88-35070642257c/payload-pre-processing/0.log" Jul 07 22:54:41.469664 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:41.469633 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-265jt_11cf1efb-9f34-49bf-a6fb-cd38f4fd1289/payload-processing/0.log" Jul 07 22:54:41.927980 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:41.927948 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8bt5s_ce339944-f2c9-417c-baec-7d306f707bf1/main/0.log" Jul 07 22:54:42.265231 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:42.265208 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvfmx_aafe4f29-bfa8-4a0c-9383-f19275982b65/main/0.log" Jul 07 22:54:46.669727 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:46.669691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:46.766280 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:46.766242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" limit=1024 Jul 07 22:54:49.508005 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:49.507979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tv8b4_d37e905e-0eca-4b71-8604-0d8e0d47f1f7/global-pull-secret-syncer/0.log" Jul 07 22:54:49.563308 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:49.563281 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b2jwl_da70ff2e-0d4f-40b8-b889-24ca68d9d03a/konnectivity-agent/0.log" Jul 07 22:54:49.706808 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:49.706778 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-33.ec2.internal_6dbfd7c39ad1e792f6ab1faf67c3a565/haproxy/0.log" Jul 07 22:54:53.795800 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.795771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f_e71f36f8-e9d7-4481-a18c-30d696a0860d/extract/0.log" Jul 07 22:54:53.819351 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.819327 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f_e71f36f8-e9d7-4481-a18c-30d696a0860d/util/0.log" Jul 07 22:54:53.843956 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.843930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598795f_e71f36f8-e9d7-4481-a18c-30d696a0860d/pull/0.log" Jul 07 22:54:53.873422 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.873398 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd_09fb116f-fc1f-45e8-ad0c-47875fa2a6cd/extract/0.log" Jul 07 22:54:53.898478 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.898448 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd_09fb116f-fc1f-45e8-ad0c-47875fa2a6cd/util/0.log" Jul 07 22:54:53.920579 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.920554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065kvd_09fb116f-fc1f-45e8-ad0c-47875fa2a6cd/pull/0.log" Jul 07 22:54:53.950268 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.950243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr_7ace4843-1901-4efc-8ad6-5733cb65a0ce/extract/0.log" Jul 07 22:54:53.982926 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:53.982902 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr_7ace4843-1901-4efc-8ad6-5733cb65a0ce/util/0.log" Jul 07 22:54:54.003507 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.003466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b5zpr_7ace4843-1901-4efc-8ad6-5733cb65a0ce/pull/0.log" Jul 07 22:54:54.034626 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.034585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq_bb1d7a83-ed51-4fd5-ae4c-05d331d72376/extract/0.log" Jul 07 22:54:54.062401 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.062336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq_bb1d7a83-ed51-4fd5-ae4c-05d331d72376/util/0.log" Jul 07 22:54:54.086228 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.086199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cjsq_bb1d7a83-ed51-4fd5-ae4c-05d331d72376/pull/0.log" Jul 07 22:54:54.662104 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.662079 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bdzv8_49960870-18b9-407c-a498-540ddcee87c8/manager/0.log" Jul 07 22:54:54.735639 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.735598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4t69r_ed2f2679-cdc3-4bf7-a210-8beb3a3ffd05/registry-server/0.log" Jul 07 22:54:54.843656 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.843607 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xwsnp_5ca13e14-474a-4867-8f73-19eb3cd20e2a/manager/0.log" Jul 07 22:54:54.962945 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:54.962862 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9jtzh_5b0c763e-b58e-4b12-a689-abe66e5d8e61/manager/0.log" Jul 07 22:54:56.842229 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:56.842203 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kfdsh_91891956-0904-4d37-be0a-0f46d6ab3051/kube-state-metrics/0.log" Jul 07 22:54:56.864975 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:56.864955 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kfdsh_91891956-0904-4d37-be0a-0f46d6ab3051/kube-rbac-proxy-main/0.log" Jul 07 22:54:56.891907 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:56.891879 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kfdsh_91891956-0904-4d37-be0a-0f46d6ab3051/kube-rbac-proxy-self/0.log" Jul 07 22:54:56.998332 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:56.998245 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dchl4_ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d/node-exporter/0.log" Jul 07 22:54:57.021493 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.021469 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dchl4_ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d/kube-rbac-proxy/0.log" Jul 07 22:54:57.043077 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.043056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dchl4_ac6ebd48-c137-4a6f-9c5f-b4d20f59ad6d/init-textfile/0.log" Jul 07 22:54:57.238331 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.238303 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-zgsx2_de5d9495-9f96-4c9f-9046-6e0dc0b74832/kube-rbac-proxy-main/0.log" Jul 07 22:54:57.267966 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.267887 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-zgsx2_de5d9495-9f96-4c9f-9046-6e0dc0b74832/kube-rbac-proxy-self/0.log" Jul 07 22:54:57.289778 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.289751 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-zgsx2_de5d9495-9f96-4c9f-9046-6e0dc0b74832/openshift-state-metrics/0.log" Jul 07 22:54:57.549376 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.549296 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-8995z_f4c03ad0-8219-4413-a6a6-fe5b416e7107/prometheus-operator-admission-webhook/0.log" Jul 07 22:54:57.586377 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.586351 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d977468f6-wp8wm_276f0a8d-170b-4016-8c85-70ffcdfd2eaa/telemeter-client/0.log" Jul 07 22:54:57.607776 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.607753 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d977468f6-wp8wm_276f0a8d-170b-4016-8c85-70ffcdfd2eaa/reload/0.log" Jul 07 22:54:57.631858 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.631828 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d977468f6-wp8wm_276f0a8d-170b-4016-8c85-70ffcdfd2eaa/kube-rbac-proxy/0.log" Jul 07 22:54:57.669992 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.669966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c9d6dc6bc-7kptw_aa81f32a-cdd8-43cf-8a75-481db982bcb6/thanos-query/0.log" Jul 07 22:54:57.693075 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.693051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c9d6dc6bc-7kptw_aa81f32a-cdd8-43cf-8a75-481db982bcb6/kube-rbac-proxy-web/0.log" Jul 07 22:54:57.717047 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.717027 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c9d6dc6bc-7kptw_aa81f32a-cdd8-43cf-8a75-481db982bcb6/kube-rbac-proxy/0.log" Jul 07 22:54:57.740238 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.740214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c9d6dc6bc-7kptw_aa81f32a-cdd8-43cf-8a75-481db982bcb6/prom-label-proxy/0.log" Jul 07 22:54:57.764541 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.764516 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c9d6dc6bc-7kptw_aa81f32a-cdd8-43cf-8a75-481db982bcb6/kube-rbac-proxy-rules/0.log" Jul 07 22:54:57.786304 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:57.786283 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c9d6dc6bc-7kptw_aa81f32a-cdd8-43cf-8a75-481db982bcb6/kube-rbac-proxy-metrics/0.log" Jul 07 22:54:59.445835 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.445796 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27"] Jul 07 22:54:59.446409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.446389 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4003633f-e460-40d2-8374-368a66b5acc3" containerName="maas-api" Jul 07 22:54:59.446495 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.446412 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4003633f-e460-40d2-8374-368a66b5acc3" containerName="maas-api" Jul 07 22:54:59.446549 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.446515 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4003633f-e460-40d2-8374-368a66b5acc3" containerName="maas-api" Jul 07 22:54:59.449973 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.449954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.452262 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.452243 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xs5cp\"/\"kube-root-ca.crt\"" Jul 07 22:54:59.452409 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.452392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xs5cp\"/\"default-dockercfg-7sh64\"" Jul 07 22:54:59.452505 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.452486 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xs5cp\"/\"openshift-service-ca.crt\"" Jul 07 22:54:59.456518 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.456496 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27"] Jul 07 22:54:59.527160 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.527120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-lib-modules\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.527160 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.527161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fk8f\" (UniqueName: \"kubernetes.io/projected/d145b046-20e6-4e9b-a755-5926393d4512-kube-api-access-5fk8f\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.527414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.527178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-sys\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.527414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.527282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-proc\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.527414 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.527316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-podres\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628186 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-lib-modules\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628186 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fk8f\" (UniqueName: \"kubernetes.io/projected/d145b046-20e6-4e9b-a755-5926393d4512-kube-api-access-5fk8f\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-sys\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628314 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-lib-modules\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628374 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-sys\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-proc\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628446 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-podres\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628452 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-proc\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.628661 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.628568 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d145b046-20e6-4e9b-a755-5926393d4512-podres\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.636454 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.636423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fk8f\" (UniqueName: \"kubernetes.io/projected/d145b046-20e6-4e9b-a755-5926393d4512-kube-api-access-5fk8f\") pod \"perf-node-gather-daemonset-zxk27\" (UID: \"d145b046-20e6-4e9b-a755-5926393d4512\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.761537 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.761500 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:54:59.897533 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:54:59.897507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27"] Jul 07 22:54:59.899275 ip-10-0-142-33 kubenswrapper[2581]: W0707 22:54:59.899247 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd145b046_20e6_4e9b_a755_5926393d4512.slice/crio-427ee0eb68ffaf08aca25c4d11e4cf0bcb1305b431c57c9b61f9250bb3d868ad WatchSource:0}: Error finding container 427ee0eb68ffaf08aca25c4d11e4cf0bcb1305b431c57c9b61f9250bb3d868ad: Status 404 returned error can't find the container with id 427ee0eb68ffaf08aca25c4d11e4cf0bcb1305b431c57c9b61f9250bb3d868ad Jul 07 22:55:00.151717 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:00.151686 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66fbb56444-ftv8n_eb1da216-62d1-4db8-abd2-59f75f34a42b/console/0.log" Jul 07 22:55:00.286744 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:00.286648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" event={"ID":"d145b046-20e6-4e9b-a755-5926393d4512","Type":"ContainerStarted","Data":"2ae5421259bbf81949970cb5f302ee453be5507dcbc730b2759b829a9488bcde"} Jul 07 22:55:00.286744 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:00.286702 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:55:00.286744 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:00.286719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" event={"ID":"d145b046-20e6-4e9b-a755-5926393d4512","Type":"ContainerStarted","Data":"427ee0eb68ffaf08aca25c4d11e4cf0bcb1305b431c57c9b61f9250bb3d868ad"} Jul 07 22:55:00.305445 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:00.305394 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" podStartSLOduration=1.305378662 podStartE2EDuration="1.305378662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:55:00.30310849 +0000 UTC m=+2398.761812158" watchObservedRunningTime="2026-07-07 22:55:00.305378662 +0000 UTC m=+2398.764082316" Jul 07 22:55:01.780746 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:01.780718 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7c9z8_ddd9897a-cb21-49c7-b82e-929eb2567217/dns/0.log" Jul 07 22:55:01.803125 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:01.803103 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7c9z8_ddd9897a-cb21-49c7-b82e-929eb2567217/kube-rbac-proxy/0.log" Jul 07 22:55:01.948202 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:01.948167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfhlz_354606f8-4cbc-4af8-9084-39dcf016d062/dns-node-resolver/0.log" Jul 07 22:55:02.557956 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:02.557926 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-szlv7_9bc8f067-e9f7-47a8-a118-cfec03bb0846/node-ca/0.log" Jul 07 22:55:03.666867 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:03.666820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-545d6_3d9c656d-4160-4df7-8fdf-b6967ad2b2b7/discovery/0.log" Jul 07 22:55:03.689266 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:03.689241 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776659d659-h6thb_86dab0ae-3671-49c1-a348-a4889660b724/kube-auth-proxy/0.log" Jul 07 22:55:03.807761 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:03.807731 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k25kq_151482dd-1f8e-403f-ab88-35070642257c/payload-pre-processing/0.log" Jul 07 22:55:03.855047 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:03.854999 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-265jt_11cf1efb-9f34-49bf-a6fb-cd38f4fd1289/payload-processing/0.log" Jul 07 22:55:04.604938 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:04.604910 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sx49m_9f2691d4-465f-4fdb-a4a6-80fbe05bddf0/serve-healthcheck-canary/0.log" Jul 07 22:55:05.092138 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:05.092096 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2z5t6_4276b593-d9ba-48be-954b-d0feb2f25424/kube-rbac-proxy/0.log" Jul 07 22:55:05.114865 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:05.114840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2z5t6_4276b593-d9ba-48be-954b-d0feb2f25424/exporter/0.log" Jul 07 22:55:05.136375 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:05.136348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2z5t6_4276b593-d9ba-48be-954b-d0feb2f25424/extractor/0.log" Jul 07 22:55:06.302641 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:06.302591 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-zxk27" Jul 07 22:55:07.483885 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:07.483848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b4b8w_b063713b-68a4-49bf-ad39-cf48d8ea7aa4/manager/0.log" Jul 07 22:55:07.621549 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:07.621516 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zk48f_11c8bb22-d6b7-4eea-a144-95b279481f4a/manager/0.log" Jul 07 22:55:07.656456 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:07.656429 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bdf95f944-r4vgw_2f65d232-63bb-4a09-bff8-fc151eb24fba/maas-api/0.log" Jul 07 22:55:07.808999 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:07.808971 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-765c58f989-njlqp_109739f4-c30c-47c2-a7b2-6941d6699f25/manager/0.log" Jul 07 22:55:07.909089 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:07.909057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4dknx_33c08d12-ed40-4aaa-b47f-bb24ebba3ff7/manager/0.log" Jul 07 22:55:07.995575 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:07.995549 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb_b40c66af-6f09-462b-b758-07491e8d8e65/manager/0.log" Jul 07 22:55:08.020700 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:08.020674 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-7fncb_b40c66af-6f09-462b-b758-07491e8d8e65/copy-manifests/0.log" Jul 07 22:55:08.139231 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:08.139162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cnj85_106f0e80-98d2-4592-aa5a-c0baa7d6b909/postgres/0.log" Jul 07 22:55:09.496311 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:09.496290 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9xtgf_5b8160fe-621c-461b-a2aa-6c05a6c3eb5e/openshift-lws-operator/0.log" Jul 07 22:55:09.824383 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:09.824351 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-545d6_3d9c656d-4160-4df7-8fdf-b6967ad2b2b7/discovery/0.log" Jul 07 22:55:09.839178 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:09.839156 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776659d659-h6thb_86dab0ae-3671-49c1-a348-a4889660b724/kube-auth-proxy/0.log" Jul 07 22:55:09.927584 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:09.927551 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k25kq_151482dd-1f8e-403f-ab88-35070642257c/payload-pre-processing/0.log" Jul 07 22:55:09.965221 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:09.965186 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-265jt_11cf1efb-9f34-49bf-a6fb-cd38f4fd1289/payload-processing/0.log" Jul 07 22:55:11.310767 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:11.310740 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-545d6_3d9c656d-4160-4df7-8fdf-b6967ad2b2b7/discovery/0.log" Jul 07 22:55:11.322887 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:11.322858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776659d659-h6thb_86dab0ae-3671-49c1-a348-a4889660b724/kube-auth-proxy/0.log" Jul 07 22:55:11.415249 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:11.415221 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k25kq_151482dd-1f8e-403f-ab88-35070642257c/payload-pre-processing/0.log" Jul 07 22:55:11.453680 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:11.453639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-265jt_11cf1efb-9f34-49bf-a6fb-cd38f4fd1289/payload-processing/0.log" Jul 07 22:55:16.087379 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.087351 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/kube-multus-additional-cni-plugins/0.log" Jul 07 22:55:16.109818 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.109793 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/egress-router-binary-copy/0.log" Jul 07 22:55:16.132573 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.132550 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/cni-plugins/0.log" Jul 07 22:55:16.153429 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.153404 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/bond-cni-plugin/0.log" Jul 07 22:55:16.175080 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.175059 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/routeoverride-cni/0.log" Jul 07 22:55:16.197914 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.197892 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/whereabouts-cni-bincopy/0.log" Jul 07 22:55:16.218855 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.218834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qjtmk_721d58d1-2a79-46a6-ab60-cc26a2de15d5/whereabouts-cni/0.log" Jul 07 22:55:16.406646 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.406555 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fzxxr_85cba916-2b2c-42e7-a6fc-d31e84cc898e/kube-multus/0.log" Jul 07 22:55:16.502392 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.502359 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g25gv_e571d82d-77e7-4924-98f2-60190970855a/network-metrics-daemon/0.log" Jul 07 22:55:16.523780 ip-10-0-142-33 kubenswrapper[2581]: I0707 22:55:16.523757 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g25gv_e571d82d-77e7-4924-98f2-60190970855a/kube-rbac-proxy/0.log"